2022-03-21T13:46:18.453 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-21T13:46:18.454 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749908 --name vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} --verbose --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749908/orig.config.yaml 2022-03-21T13:46:18.501 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-03-21T13:46:18.572 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749908 branch: wip-vshankar-testing-20220319-163539 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} email: vshankar@redhat.com first_in_suite: false job_id: '6749908' kernel: client: sha1: distro flavor: default kdb: true sha1: 8c5f4f463f1899102a5e979f88c37daab5f66d1e last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-vshankar-testing-20220319-163539 ceph: cephfs: max_mds: 5 mds_dir_prefetch: true session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: false mds op complaint time: 180 mds verify scatter: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: d3799b8cfa5046465710eadeea2bed7bb4681409 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: d3799b8cfa5046465710eadeea2bed7bb4681409 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20220319-163539 sha1: d3799b8cfa5046465710eadeea2bed7bb4681409 owner: scheduled_vshankar@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 sha1: d3799b8cfa5046465710eadeea2bed7bb4681409 sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20220319-163539 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d3799b8cfa5046465710eadeea2bed7bb4681409/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: d3799b8cfa5046465710eadeea2bed7bb4681409 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi160.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC988s3kt/75zAAEUEL+eeU9mmYpwqRSDg0QqnZKrzpg+vgMIxKXpwB5rO4YbbDbASzQ+aTHXZCKik0OeRYQgYprKpEh0hgiGcitV31qBKrvjNpU6Q4uHM6MWUdNeaaxL8FnOnihKguaFLUQQtUR3YZ6LWlPwNO+DovP0159oXHMP/hzTcExEpyo49C5Xcxj1MNFwnkcq4sM5ZaUwm4APDEFVEv6HVuuMHwxpHKT7MM16GkhVkklosERyHMNuDwCPBnPuE0y0t2RLCLrEVESlcWdOFAqM2+cplA0o777eQatau0OHGmQ680NqQrscuIBqik4cG3UFV3vMe4tR/Bye/PUpJWV+xyjlvklUuc2NSMs8hQBCWQwolaQrqI19s5Ba0J5IcUEWYePqKjqSTm/gM/2YqLNrGeO5gAle7yRod8uMHLAd3zo4641r+B49hxqLakFTI0Rqd+OE+pOfRcaSfZ5JWKFkE1bjYsNFxQWn5w7SlmMswa6FP7hfttG84Ivf8= smithi171.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxJU09wnLkWVg2DloFgQ2GG793CtVaxa/W35bTelRDP+PX1d6+FJrRbsq/Nbp7gHitgteoN8BrNdcdTx2AORypnig/gejWhb+0tUvrLu8OvFniyz2jJd2OtenzAeMehorqFqXTiZKHKip0/waj0YXi0rj7TSm4wyh/xVSVUqC91OgV59o+/UI6yku09p9zxMo/IAJdGNPFD5zpZ0P9YH9677m8ZpcIMJME7uPZJcHZsfn/unKgWeacTD33wof+Fe1rCa6LVM82UC7VMkIDVRQoQvAOn2ZK+lyaMUaZNNysTok6mrAvmGvZ9/x+rWdiR5YmT2u4Y9hCRC3iBQlSk2zTcJbuHgX3jHwhLMj616kh2MDalhy3A7zs9xksfvqHyFDZDH31UduA0pIVeRHLAsfIW5ks5SH4WqMLiLA5lPNiMzEzK5ybxhUJ8ntKAhPk2jNVXTIBXYxi7quPzqCzI5vMcz/FBK2CSYZ9m5Bn/mRnLi0OhkVeGSKAdhQWz71tQ7E= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - mds_thrash: null - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology_branch: master teuthology_sha1: a4e18662e5de936eb0ac089e531b933ecbcadb0a timestamp: 2022-03-21_06:07:09 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.22301 2022-03-21T13:46:18.573 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d3799b8cfa5046465710eadeea2bed7bb4681409/qa; will attempt to use it 2022-03-21T13:46:18.574 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d3799b8cfa5046465710eadeea2bed7bb4681409/qa/tasks 2022-03-21T13:46:18.574 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-03-21T13:46:18.576 INFO:teuthology.task.internal:Checking packages... 2022-03-21T13:46:18.596 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'd3799b8cfa5046465710eadeea2bed7bb4681409' 2022-03-21T13:46:18.597 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-03-21T13:46:18.597 INFO:teuthology.packaging:ref: None 2022-03-21T13:46:18.598 INFO:teuthology.packaging:tag: None 2022-03-21T13:46:18.598 INFO:teuthology.packaging:branch: wip-vshankar-testing-20220319-163539 2022-03-21T13:46:18.598 INFO:teuthology.packaging:sha1: d3799b8cfa5046465710eadeea2bed7bb4681409 2022-03-21T13:46:18.599 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20220319-163539 2022-03-21T13:46:18.887 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-11208.gd3799b8c 2022-03-21T13:46:18.888 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-03-21T13:46:18.896 INFO:teuthology.task.internal:no buildpackages task found 2022-03-21T13:46:18.897 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-03-21T13:46:19.132 INFO:teuthology.task.internal:Saving configuration 2022-03-21T13:46:19.150 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-03-21T13:46:19.168 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-21T13:46:19.192 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749908', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-03-21 13:41:13.821741', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI8srM/+hnv3ZxmrTr7DRiJ8IqPxhOcYaEaf6kd+ztWCXD8swivEsyUhQUZfFOJe5/iVrwiWlOnXQc4gbUUNvlI='} 2022-03-21T13:46:19.214 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749908', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-03-21 13:41:13.820492', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGskoFNSLqcUi+zqlz4RPqr0S47YLPlFMVqAwf1vZ8svE8lPsW+vwv/ZY27R53zzeMxbFoG/JxOCz1/zxrKu9GA='} 2022-03-21T13:46:19.214 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-03-21T13:46:19.221 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-03-21T13:46:19.221 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-03-21T13:46:19.221 INFO:teuthology.run_tasks:Running task console_log... 2022-03-21T13:46:19.305 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f770efd9ea0>, signals=[15]) 2022-03-21T13:46:19.306 INFO:teuthology.run_tasks:Running task internal.connect... 2022-03-21T13:46:19.314 INFO:teuthology.task.internal:Opening connections... 2022-03-21T13:46:19.315 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2022-03-21T13:46:19.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-21T13:46:19.388 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2022-03-21T13:46:19.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-21T13:46:19.456 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-03-21T13:46:19.465 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2022-03-21T13:46:19.482 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2022-03-21T13:46:19.482 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2022-03-21T13:46:19.537 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux" 2022-03-21T13:46:19.538 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.4 (Ootpa)" 2022-03-21T13:46:19.538 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel" 2022-03-21T13:46:19.538 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora" 2022-03-21T13:46:19.539 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.4" 2022-03-21T13:46:19.539 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2022-03-21T13:46:19.539 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-03-21T13:46:19.539 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2022-03-21T13:46:19.540 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-03-21T13:46:19.540 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/" 2022-03-21T13:46:19.540 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-03-21T13:46:19.540 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-21T13:46:19.540 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:46:19.540 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-21T13:46:19.541 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-03-21T13:46:19.541 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-03-21T13:46:19.541 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-03-21T13:46:19.542 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2022-03-21T13:46:19.561 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2022-03-21T13:46:19.578 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2022-03-21T13:46:19.578 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2022-03-21T13:46:19.634 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Red Hat Enterprise Linux" 2022-03-21T13:46:19.634 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8.4 (Ootpa)" 2022-03-21T13:46:19.635 INFO:teuthology.orchestra.run.smithi171.stdout:ID="rhel" 2022-03-21T13:46:19.635 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="fedora" 2022-03-21T13:46:19.635 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8.4" 2022-03-21T13:46:19.635 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8" 2022-03-21T13:46:19.635 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-03-21T13:46:19.636 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2022-03-21T13:46:19.636 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-03-21T13:46:19.636 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.redhat.com/" 2022-03-21T13:46:19.636 INFO:teuthology.orchestra.run.smithi171.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-03-21T13:46:19.637 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-21T13:46:19.637 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:46:19.637 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-21T13:46:19.637 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-03-21T13:46:19.637 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-03-21T13:46:19.638 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-03-21T13:46:19.638 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2022-03-21T13:46:19.655 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-03-21T13:46:19.667 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-03-21T13:46:19.695 INFO:teuthology.task.internal:Checking for old test directory... 2022-03-21T13:46:19.696 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2022-03-21T13:46:19.698 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2022-03-21T13:46:19.713 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-03-21T13:46:19.724 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-03-21T13:46:19.725 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2022-03-21T13:46:19.753 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2022-03-21T13:46:19.771 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-03-21T13:46:19.823 INFO:teuthology.run_tasks:Running task kernel... 2022-03-21T13:46:19.842 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8c5f4f463f1899102a5e979f88c37daab5f66d1e'} 2022-03-21T13:46:19.843 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2022-03-21T13:46:19.843 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2022-03-21T13:46:19.844 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2022-03-21T13:46:19.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-03-21T13:46:19.860 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2022-03-21T13:46:19.916 INFO:teuthology.orchestra.run.smithi160.stdout:4.18.0-348.20.1.el8_5.x86_64 2022-03-21T13:46:19.917 INFO:teuthology.task.kernel:Running kernel on smithi160: 4.18.0-348.20.1.el8_5.x86_64 2022-03-21T13:46:19.917 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum install -y kernel 2022-03-21T13:46:21.273 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2022-03-21T13:46:21.274 INFO:teuthology.orchestra.run.smithi160.stdout:Unable to read consumer identity 2022-03-21T13:46:21.405 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:46:21.405 INFO:teuthology.orchestra.run.smithi160.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2022-03-21T13:46:21.405 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:46:22.812 INFO:teuthology.orchestra.run.smithi160.stdout:Copr repo for python3-asyncssh owned by ceph 38 kB/s | 3.5 kB 00:00 2022-03-21T13:46:25.038 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 5.1 MB/s | 11 MB 00:02 2022-03-21T13:46:27.339 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2022-03-21T13:46:27.955 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-4.18.0-305.el8.x86_64 is already installed. 2022-03-21T13:46:27.955 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-4.18.0-348.20.1.el8_5.x86_64 is already installed. 2022-03-21T13:46:28.114 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2022-03-21T13:46:28.115 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2022-03-21T13:46:28.115 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2022-03-21T13:46:28.242 DEBUG:teuthology.orchestra.run.smithi160:> echo no | sudo yum reinstall kernel || true 2022-03-21T13:46:28.558 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2022-03-21T13:46:28.559 INFO:teuthology.orchestra.run.smithi160.stdout:Unable to read consumer identity 2022-03-21T13:46:28.616 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:46:28.616 INFO:teuthology.orchestra.run.smithi160.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2022-03-21T13:46:28.617 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:46:28.841 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:01 ago on Mon 21 Mar 2022 01:46:27 PM UTC. 2022-03-21T13:46:28.971 INFO:teuthology.orchestra.run.smithi160.stdout:Installed package kernel-4.18.0-305.el8.x86_64 (from anaconda) not available. 2022-03-21T13:46:28.972 INFO:teuthology.orchestra.run.smithi160.stdout:Installed package kernel-4.18.0-348.20.1.el8_5.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2022-03-21T13:46:29.007 INFO:teuthology.orchestra.run.smithi160.stderr:Error: No packages marked for reinstall. 2022-03-21T13:46:29.050 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum reinstall -y kernel || true 2022-03-21T13:46:29.363 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2022-03-21T13:46:29.364 INFO:teuthology.orchestra.run.smithi160.stdout:Unable to read consumer identity 2022-03-21T13:46:29.411 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:46:29.411 INFO:teuthology.orchestra.run.smithi160.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2022-03-21T13:46:29.411 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:46:29.635 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:02 ago on Mon 21 Mar 2022 01:46:27 PM UTC. 2022-03-21T13:46:29.769 INFO:teuthology.orchestra.run.smithi160.stdout:Installed package kernel-4.18.0-305.el8.x86_64 (from anaconda) not available. 2022-03-21T13:46:29.770 INFO:teuthology.orchestra.run.smithi160.stdout:Installed package kernel-4.18.0-348.20.1.el8_5.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2022-03-21T13:46:29.786 INFO:teuthology.orchestra.run.smithi160.stderr:Error: No packages marked for reinstall. 2022-03-21T13:46:29.833 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel --last | head -n 1 2022-03-21T13:46:29.952 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-4.18.0-348.20.1.el8_5.x86_64 Fri 18 Mar 2022 06:31:20 PM UTC 2022-03-21T13:46:29.953 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.20.1.el8_5.x86_64 2022-03-21T13:46:29.954 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-03-21T13:46:29.954 DEBUG:teuthology.parallel:result is None 2022-03-21T13:46:29.954 INFO:teuthology.run_tasks:Running task internal.base... 2022-03-21T13:46:29.964 INFO:teuthology.task.internal:Creating test directory... 2022-03-21T13:46:29.965 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-03-21T13:46:29.967 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-03-21T13:46:29.985 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-03-21T13:46:30.116 INFO:teuthology.run_tasks:Running task internal.archive... 2022-03-21T13:46:30.145 INFO:teuthology.task.internal:Creating archive directory... 2022-03-21T13:46:30.146 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-03-21T13:46:30.149 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-03-21T13:46:30.191 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-03-21T13:46:30.200 INFO:teuthology.task.internal:Enabling coredump saving... 2022-03-21T13:46:30.201 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2022-03-21T13:46:30.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-03-21T13:46:30.241 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-03-21T13:46:30.243 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-03-21T13:46:30.277 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-21T13:46:30.296 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-21T13:46:30.321 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-21T13:46:30.340 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-21T13:46:30.342 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-03-21T13:46:30.350 INFO:teuthology.task.internal:Configuring sudo... 2022-03-21T13:46:30.350 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-03-21T13:46:30.353 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-03-21T13:46:30.409 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-03-21T13:46:30.417 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-03-21T13:46:30.418 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-03-21T13:46:30.420 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-03-21T13:46:30.464 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-21T13:46:30.510 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-21T13:46:30.564 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-21T13:46:30.641 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-21T13:46:30.684 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:46:30.684 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-03-21T13:46:30.746 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-21T13:46:30.785 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-21T13:46:30.833 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-21T13:46:30.910 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-21T13:46:30.955 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:46:30.955 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-03-21T13:46:31.020 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2022-03-21T13:46:31.027 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2022-03-21T13:46:31.073 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-03-21T13:46:31.113 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-03-21T13:46:31.472 INFO:teuthology.run_tasks:Running task internal.timer... 2022-03-21T13:46:31.482 INFO:teuthology.task.internal:Starting timer... 2022-03-21T13:46:31.482 INFO:teuthology.run_tasks:Running task pcp... 2022-03-21T13:46:31.589 INFO:teuthology.run_tasks:Running task selinux... 2022-03-21T13:46:31.640 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2022-03-21T13:46:31.640 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2022-03-21T13:46:31.690 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: [ OK ] 2022-03-21T13:46:31.691 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2022-03-21T13:46:31.745 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: [ OK ] 2022-03-21T13:46:31.746 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-03-21T13:46:31.747 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2022-03-21T13:46:31.786 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2022-03-21T13:46:31.786 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2022-03-21T13:46:31.810 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2022-03-21T13:46:31.810 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi160.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2022-03-21T13:46:31.811 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-03-21T13:46:31.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-03-21T13:46:31.850 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-03-21T13:46:31.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-03-21T13:46:31.876 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-03-21T13:46:31.876 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2022-03-21T13:46:31.915 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2022-03-21T13:46:31.940 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-03-21T13:46:31.949 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2022-03-21T13:46:31.955 INFO:teuthology.repo_utils:Fetching master from origin 2022-03-21T13:46:31.994 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2022-03-21T13:46:32.014 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-03-21T13:46:32.016 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi160.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2022-03-21T13:51:15.482 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi160.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2022-03-21T13:51:15.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2022-03-21T13:51:15.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-21T13:51:15.559 DEBUG:teuthology.orchestra.run.smithi160:> true 2022-03-21T13:51:15.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2022-03-21T13:51:15.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-21T13:51:15.687 DEBUG:teuthology.orchestra.run.smithi171:> true 2022-03-21T13:51:15.748 INFO:teuthology.run_tasks:Running task clock... 2022-03-21T13:51:15.761 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-03-21T13:51:15.762 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-03-21T13:51:15.764 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-03-21T13:51:15.766 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-03-21T13:51:15.766 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-03-21T13:51:15.793 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-03-21T13:51:15.807 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-03-21T13:51:15.818 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-03-21T13:51:15.833 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-03-21T13:51:15.847 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2022-03-21T13:51:15.857 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2022-03-21T13:51:15.871 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-03-21T13:51:15.881 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2022-03-21T13:51:15.884 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-03-21T13:51:15.892 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2022-03-21T13:51:15.906 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-03-21T13:51:15.920 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-03-21T13:51:15.945 INFO:teuthology.orchestra.run.smithi160.stderr:bash: ntpq: command not found 2022-03-21T13:51:15.948 INFO:teuthology.orchestra.run.smithi160.stdout:210 Number of sources = 4 2022-03-21T13:51:15.948 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-03-21T13:51:15.948 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2022-03-21T13:51:15.948 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-21T13:51:15.949 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-21T13:51:15.949 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-21T13:51:15.949 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-21T13:51:15.981 INFO:teuthology.orchestra.run.smithi171.stderr:bash: ntpq: command not found 2022-03-21T13:51:15.983 INFO:teuthology.orchestra.run.smithi171.stdout:210 Number of sources = 4 2022-03-21T13:51:15.984 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-03-21T13:51:15.984 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2022-03-21T13:51:15.984 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-21T13:51:15.984 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-21T13:51:15.985 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-21T13:51:15.985 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-21T13:51:15.986 INFO:teuthology.run_tasks:Running task install... 2022-03-21T13:51:15.994 DEBUG:teuthology.task.install:project ceph 2022-03-21T13:51:15.995 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd3799b8cfa5046465710eadeea2bed7bb4681409'}} 2022-03-21T13:51:15.995 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'd3799b8cfa5046465710eadeea2bed7bb4681409'} 2022-03-21T13:51:15.996 INFO:teuthology.task.install:Using flavor: default 2022-03-21T13:51:16.001 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-03-21T13:51:16.002 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-03-21T13:51:16.002 DEBUG:teuthology.orchestra.run.smithi160:> sudo lsb_release -is 2022-03-21T13:51:16.040 INFO:teuthology.orchestra.run.smithi160.stdout:RedHatEnterprise 2022-03-21T13:51:16.042 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-03-21T13:51:16.042 DEBUG:teuthology.orchestra.run.smithi171:> sudo lsb_release -is 2022-03-21T13:51:16.043 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd3799b8cfa5046465710eadeea2bed7bb4681409', 'tag': None, 'wait_for_package': False} 2022-03-21T13:51:16.043 DEBUG:teuthology.orchestra.run.smithi160:> sudo lsb_release -is 2022-03-21T13:51:16.081 INFO:teuthology.orchestra.run.smithi171.stdout:RedHatEnterprise 2022-03-21T13:51:16.082 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-03-21T13:51:16.083 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd3799b8cfa5046465710eadeea2bed7bb4681409', 'tag': None, 'wait_for_package': False} 2022-03-21T13:51:16.083 DEBUG:teuthology.orchestra.run.smithi171:> sudo lsb_release -is 2022-03-21T13:51:16.119 INFO:teuthology.orchestra.run.smithi160.stdout:RedHatEnterprise 2022-03-21T13:51:16.120 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-03-21T13:51:16.121 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d3799b8cfa5046465710eadeea2bed7bb4681409 2022-03-21T13:51:16.162 INFO:teuthology.orchestra.run.smithi171.stdout:RedHatEnterprise 2022-03-21T13:51:16.163 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-03-21T13:51:16.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d3799b8cfa5046465710eadeea2bed7bb4681409 2022-03-21T13:51:16.440 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220319-163539/d3799b8cfa5046465710eadeea2bed7bb4681409/centos/8/flavors/default/ 2022-03-21T13:51:16.440 INFO:teuthology.task.install.rpm:Package version is 17.0.0-11208.gd3799b8c 2022-03-21T13:51:16.479 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220319-163539/d3799b8cfa5046465710eadeea2bed7bb4681409/centos/8/flavors/default/ 2022-03-21T13:51:16.479 INFO:teuthology.task.install.rpm:Package version is 17.0.0-11208.gd3799b8c 2022-03-21T13:51:16.683 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220319-163539/d3799b8cfa5046465710eadeea2bed7bb4681409/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220319-163539/d3799b8cfa5046465710eadeea2bed7bb4681409/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220319-163539/d3799b8cfa5046465710eadeea2bed7bb4681409/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-03-21T13:51:16.684 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:51:16.684 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-03-21T13:51:16.709 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-03-21T13:51:16.709 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d3799b8cfa5046465710eadeea2bed7bb4681409/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-03-21T13:51:16.721 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220319-163539/d3799b8cfa5046465710eadeea2bed7bb4681409/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220319-163539/d3799b8cfa5046465710eadeea2bed7bb4681409/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220319-163539/d3799b8cfa5046465710eadeea2bed7bb4681409/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-03-21T13:51:16.722 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:51:16.722 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-03-21T13:51:16.746 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-03-21T13:51:16.746 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d3799b8cfa5046465710eadeea2bed7bb4681409/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-03-21T13:51:16.777 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-03-21T13:51:16.811 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-03-21T13:51:16.851 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-03-21T13:51:16.885 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-03-21T13:51:16.915 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2022-03-21T13:51:16.916 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2022-03-21T13:51:16.948 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2022-03-21T13:51:16.949 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2022-03-21T13:51:17.270 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2022-03-21T13:51:17.313 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2022-03-21T13:51:17.562 INFO:teuthology.orchestra.run.smithi160.stdout:54 files removed 2022-03-21T13:51:17.606 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-03-21T13:51:17.612 INFO:teuthology.orchestra.run.smithi171.stdout:54 files removed 2022-03-21T13:51:17.656 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-03-21T13:51:17.921 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2022-03-21T13:51:17.972 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2022-03-21T13:51:18.878 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 141 kB/s | 75 kB 00:00 2022-03-21T13:51:18.913 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 142 kB/s | 75 kB 00:00 2022-03-21T13:51:19.385 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 19 kB/s | 9.1 kB 00:00 2022-03-21T13:51:19.408 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 20 kB/s | 9.1 kB 00:00 2022-03-21T13:51:19.761 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 4.0 kB/s | 1.4 kB 00:00 2022-03-21T13:51:19.797 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 3.9 kB/s | 1.4 kB 00:00 2022-03-21T13:51:19.858 INFO:teuthology.orchestra.run.smithi160.stdout:Copr repo for python3-asyncssh owned by ceph 47 kB/s | 3.5 kB 00:00 2022-03-21T13:51:19.899 INFO:teuthology.orchestra.run.smithi171.stdout:Copr repo for python3-asyncssh owned by ceph 44 kB/s | 3.5 kB 00:00 2022-03-21T13:51:21.942 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 11 MB 00:02 2022-03-21T13:51:21.945 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 5.6 MB/s | 11 MB 00:02 2022-03-21T13:51:24.244 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 1.1 MB/s | 24 kB 00:00 2022-03-21T13:51:24.273 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2022-03-21T13:51:24.590 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 136 MB/s | 38 MB 00:00 2022-03-21T13:51:24.614 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 138 MB/s | 38 MB 00:00 2022-03-21T13:51:30.005 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 122 MB/s | 33 MB 00:00 2022-03-21T13:51:30.083 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 128 MB/s | 33 MB 00:00 2022-03-21T13:51:37.786 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-03-21T13:51:37.786 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-03-21T13:51:37.797 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-1:1.30.0-7.el8.x86_64 is already installed. 2022-03-21T13:51:37.798 INFO:teuthology.orchestra.run.smithi171.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2022-03-21T13:51:37.799 INFO:teuthology.orchestra.run.smithi171.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2022-03-21T13:51:37.800 INFO:teuthology.orchestra.run.smithi171.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-03-21T13:51:37.801 INFO:teuthology.orchestra.run.smithi171.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-03-21T13:51:37.804 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-03-21T13:51:37.805 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2022-03-21T13:51:38.270 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2022-03-21T13:51:38.282 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================================== 2022-03-21T13:51:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2022-03-21T13:51:38.282 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================================== 2022-03-21T13:51:38.283 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2022-03-21T13:51:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-03-21T13:51:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 6.5 k 2022-03-21T13:51:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 5.3 M 2022-03-21T13:51:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 881 k 2022-03-21T13:51:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 169 k 2022-03-21T13:51:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 1.5 M 2022-03-21T13:51:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 104 k 2022-03-21T13:51:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 1.6 M 2022-03-21T13:51:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 7.4 M 2022-03-21T13:51:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 47 k 2022-03-21T13:51:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 9.3 M 2022-03-21T13:51:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 45 M 2022-03-21T13:51:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 257 k 2022-03-21T13:51:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 71 k 2022-03-21T13:51:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 273 k 2022-03-21T13:51:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 14 k 2022-03-21T13:51:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2022-03-21T13:51:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-03-21T13:51:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-03-21T13:51:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 25 k 2022-03-21T13:51:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 795 k 2022-03-21T13:51:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 125 k 2022-03-21T13:51:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-03-21T13:51:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2022-03-21T13:51:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-03-21T13:51:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 179 k 2022-03-21T13:51:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 366 k 2022-03-21T13:51:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 345 k 2022-03-21T13:51:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 109 k 2022-03-21T13:51:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 94 k 2022-03-21T13:51:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 3.8 M 2022-03-21T13:51:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 174 k 2022-03-21T13:51:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2022-03-21T13:51:38.290 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2022-03-21T13:51:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 2.6 M 2022-03-21T13:51:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 1.8 M 2022-03-21T13:51:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 146 k 2022-03-21T13:51:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 329 k 2022-03-21T13:51:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 3.4 M 2022-03-21T13:51:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 3.9 M 2022-03-21T13:51:38.292 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2022-03-21T13:51:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-03-21T13:51:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 20 M 2022-03-21T13:51:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 23 k 2022-03-21T13:51:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 2.3 M 2022-03-21T13:51:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 226 k 2022-03-21T13:51:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 3.9 M 2022-03-21T13:51:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 17 M 2022-03-21T13:51:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 15 k 2022-03-21T13:51:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 24 k 2022-03-21T13:51:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-03-21T13:51:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-03-21T13:51:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2022-03-21T13:51:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-03-21T13:51:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2022-03-21T13:51:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 170 k 2022-03-21T13:51:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2022-03-21T13:51:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2022-03-21T13:51:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-03-21T13:51:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2022-03-21T13:51:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-03-21T13:51:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 483 k 2022-03-21T13:51:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2022-03-21T13:51:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 4.0 M 2022-03-21T13:51:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-03-21T13:51:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2022-03-21T13:51:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-03-21T13:51:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-03-21T13:51:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-03-21T13:51:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-03-21T13:51:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2022-03-21T13:51:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-03-21T13:51:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-03-21T13:51:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-03-21T13:51:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-03-21T13:51:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-03-21T13:51:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-03-21T13:51:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-03-21T13:51:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-03-21T13:51:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-03-21T13:51:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 45 k 2022-03-21T13:51:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 105 k 2022-03-21T13:51:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-03-21T13:51:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-03-21T13:51:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-03-21T13:51:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-03-21T13:51:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 3.2.1-4.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-03-21T13:51:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-03-21T13:51:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-03-21T13:51:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-03-21T13:51:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2022-03-21T13:51:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-03-21T13:51:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-03-21T13:51:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-03-21T13:51:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-03-21T13:51:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-03-21T13:51:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-03-21T13:51:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-03-21T13:51:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-03-21T13:51:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-03-21T13:51:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-03-21T13:51:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-03-21T13:51:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-03-21T13:51:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-03-21T13:51:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-03-21T13:51:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-03-21T13:51:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-03-21T13:51:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-03-21T13:51:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-03-21T13:51:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-03-21T13:51:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-03-21T13:51:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-03-21T13:51:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-03-21T13:51:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-03-21T13:51:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-03-21T13:51:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2022-03-21T13:51:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-03-21T13:51:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-03-21T13:51:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-03-21T13:51:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-03-21T13:51:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-03-21T13:51:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-03-21T13:51:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-03-21T13:51:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-03-21T13:51:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-03-21T13:51:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-03-21T13:51:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2022-03-21T13:51:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-03-21T13:51:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2022-03-21T13:51:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:51:38.311 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2022-03-21T13:51:38.311 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================================== 2022-03-21T13:51:38.311 INFO:teuthology.orchestra.run.smithi171.stdout:Install 121 Packages 2022-03-21T13:51:38.311 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 6 Packages 2022-03-21T13:51:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:51:38.312 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 187 M 2022-03-21T13:51:38.313 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2022-03-21T13:51:38.363 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-03-21T13:51:38.364 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-03-21T13:51:38.374 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.30.0-7.el8.x86_64 is already installed. 2022-03-21T13:51:38.375 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2022-03-21T13:51:38.376 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2022-03-21T13:51:38.377 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-03-21T13:51:38.378 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-03-21T13:51:38.381 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-03-21T13:51:38.381 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2022-03-21T13:51:38.401 INFO:teuthology.orchestra.run.smithi171.stdout:(1/127): ceph-17.0.0-11208.gd3799b8c.el8.x86_64 62 kB/s | 6.5 kB 00:00 2022-03-21T13:51:38.564 INFO:teuthology.orchestra.run.smithi171.stdout:(2/127): ceph-fuse-17.0.0-11208.gd3799b8c.el8.x 5.3 MB/s | 881 kB 00:00 2022-03-21T13:51:38.603 INFO:teuthology.orchestra.run.smithi171.stdout:(3/127): ceph-immutable-object-cache-17.0.0-112 4.2 MB/s | 169 kB 00:00 2022-03-21T13:51:38.836 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2022-03-21T13:51:38.847 INFO:teuthology.orchestra.run.smithi160.stdout:====================================================================================================================== 2022-03-21T13:51:38.847 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2022-03-21T13:51:38.848 INFO:teuthology.orchestra.run.smithi160.stdout:====================================================================================================================== 2022-03-21T13:51:38.848 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2022-03-21T13:51:38.848 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-03-21T13:51:38.848 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 6.5 k 2022-03-21T13:51:38.849 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 5.3 M 2022-03-21T13:51:38.849 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 881 k 2022-03-21T13:51:38.849 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 169 k 2022-03-21T13:51:38.849 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 1.5 M 2022-03-21T13:51:38.850 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 104 k 2022-03-21T13:51:38.850 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 1.6 M 2022-03-21T13:51:38.850 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 7.4 M 2022-03-21T13:51:38.850 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 47 k 2022-03-21T13:51:38.850 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 9.3 M 2022-03-21T13:51:38.851 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 45 M 2022-03-21T13:51:38.851 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 257 k 2022-03-21T13:51:38.851 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 71 k 2022-03-21T13:51:38.851 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 273 k 2022-03-21T13:51:38.852 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 14 k 2022-03-21T13:51:38.852 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2022-03-21T13:51:38.852 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-03-21T13:51:38.852 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-03-21T13:51:38.852 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 25 k 2022-03-21T13:51:38.853 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 795 k 2022-03-21T13:51:38.853 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 125 k 2022-03-21T13:51:38.853 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-03-21T13:51:38.853 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2022-03-21T13:51:38.854 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-03-21T13:51:38.854 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 179 k 2022-03-21T13:51:38.854 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 366 k 2022-03-21T13:51:38.854 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 345 k 2022-03-21T13:51:38.854 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 109 k 2022-03-21T13:51:38.855 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 94 k 2022-03-21T13:51:38.855 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 3.8 M 2022-03-21T13:51:38.855 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 174 k 2022-03-21T13:51:38.855 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2022-03-21T13:51:38.856 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2022-03-21T13:51:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 2.6 M 2022-03-21T13:51:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 1.8 M 2022-03-21T13:51:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 146 k 2022-03-21T13:51:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 329 k 2022-03-21T13:51:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 3.4 M 2022-03-21T13:51:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 3.9 M 2022-03-21T13:51:38.857 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2022-03-21T13:51:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-03-21T13:51:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 20 M 2022-03-21T13:51:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 23 k 2022-03-21T13:51:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 2.3 M 2022-03-21T13:51:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 226 k 2022-03-21T13:51:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 3.9 M 2022-03-21T13:51:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 17 M 2022-03-21T13:51:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:17.0.0-11208.gd3799b8c.el8 ceph-noarch 15 k 2022-03-21T13:51:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 24 k 2022-03-21T13:51:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-03-21T13:51:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-03-21T13:51:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2022-03-21T13:51:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-03-21T13:51:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2022-03-21T13:51:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 170 k 2022-03-21T13:51:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2022-03-21T13:51:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2022-03-21T13:51:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-03-21T13:51:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2022-03-21T13:51:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-03-21T13:51:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 483 k 2022-03-21T13:51:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2022-03-21T13:51:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 4.0 M 2022-03-21T13:51:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-03-21T13:51:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2022-03-21T13:51:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-03-21T13:51:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-03-21T13:51:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-03-21T13:51:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-03-21T13:51:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2022-03-21T13:51:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-03-21T13:51:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-03-21T13:51:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-03-21T13:51:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-03-21T13:51:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-03-21T13:51:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-03-21T13:51:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-03-21T13:51:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-03-21T13:51:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-03-21T13:51:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 45 k 2022-03-21T13:51:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:17.0.0-11208.gd3799b8c.el8 ceph 105 k 2022-03-21T13:51:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-03-21T13:51:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-03-21T13:51:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-03-21T13:51:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-03-21T13:51:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 3.2.1-4.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-03-21T13:51:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-03-21T13:51:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-03-21T13:51:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-03-21T13:51:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2022-03-21T13:51:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-03-21T13:51:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-03-21T13:51:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-03-21T13:51:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-03-21T13:51:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-03-21T13:51:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-03-21T13:51:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-03-21T13:51:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-03-21T13:51:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-03-21T13:51:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-03-21T13:51:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-03-21T13:51:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-03-21T13:51:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-03-21T13:51:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-03-21T13:51:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-03-21T13:51:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-03-21T13:51:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-03-21T13:51:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-03-21T13:51:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-03-21T13:51:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-03-21T13:51:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-03-21T13:51:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-03-21T13:51:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-03-21T13:51:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-03-21T13:51:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2022-03-21T13:51:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-03-21T13:51:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-03-21T13:51:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-03-21T13:51:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-03-21T13:51:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-03-21T13:51:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-03-21T13:51:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-03-21T13:51:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-03-21T13:51:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-03-21T13:51:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-03-21T13:51:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2022-03-21T13:51:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-03-21T13:51:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2022-03-21T13:51:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:51:38.876 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2022-03-21T13:51:38.877 INFO:teuthology.orchestra.run.smithi160.stdout:====================================================================================================================== 2022-03-21T13:51:38.877 INFO:teuthology.orchestra.run.smithi160.stdout:Install 121 Packages 2022-03-21T13:51:38.877 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 6 Packages 2022-03-21T13:51:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:51:38.878 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 187 M 2022-03-21T13:51:38.878 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2022-03-21T13:51:38.930 INFO:teuthology.orchestra.run.smithi171.stdout:(4/127): ceph-mds-17.0.0-11208.gd3799b8c.el8.x8 7.0 MB/s | 2.3 MB 00:00 2022-03-21T13:51:39.054 INFO:teuthology.orchestra.run.smithi171.stdout:(5/127): ceph-base-17.0.0-11208.gd3799b8c.el8.x 7.0 MB/s | 5.3 MB 00:00 2022-03-21T13:51:39.088 INFO:teuthology.orchestra.run.smithi160.stdout:(1/127): ceph-17.0.0-11208.gd3799b8c.el8.x86_64 29 kB/s | 6.5 kB 00:00 2022-03-21T13:51:39.168 INFO:teuthology.orchestra.run.smithi171.stdout:(6/127): ceph-mgr-17.0.0-11208.gd3799b8c.el8.x8 6.5 MB/s | 1.5 MB 00:00 2022-03-21T13:51:39.526 INFO:teuthology.orchestra.run.smithi171.stdout:(7/127): ceph-mon-17.0.0-11208.gd3799b8c.el8.x8 8.2 MB/s | 3.9 MB 00:00 2022-03-21T13:51:40.202 INFO:teuthology.orchestra.run.smithi160.stdout:(2/127): ceph-fuse-17.0.0-11208.gd3799b8c.el8.x 791 kB/s | 881 kB 00:01 2022-03-21T13:51:40.274 INFO:teuthology.orchestra.run.smithi171.stdout:(8/127): ceph-common-17.0.0-11208.gd3799b8c.el8 10 MB/s | 20 MB 00:01 2022-03-21T13:51:40.279 INFO:teuthology.orchestra.run.smithi160.stdout:(3/127): ceph-immutable-object-cache-17.0.0-112 2.1 MB/s | 169 kB 00:00 2022-03-21T13:51:40.329 INFO:teuthology.orchestra.run.smithi171.stdout:(9/127): ceph-selinux-17.0.0-11208.gd3799b8c.el 444 kB/s | 24 kB 00:00 2022-03-21T13:51:40.730 INFO:teuthology.orchestra.run.smithi171.stdout:(10/127): ceph-radosgw-17.0.0-11208.gd3799b8c.e 7.7 MB/s | 9.3 MB 00:01 2022-03-21T13:51:40.811 INFO:teuthology.orchestra.run.smithi171.stdout:(11/127): cephfs-mirror-17.0.0-11208.gd3799b8c. 3.3 MB/s | 273 kB 00:00 2022-03-21T13:51:40.881 INFO:teuthology.orchestra.run.smithi171.stdout:(12/127): libcephfs-devel-17.0.0-11208.gd3799b8 353 kB/s | 25 kB 00:00 2022-03-21T13:51:41.053 INFO:teuthology.orchestra.run.smithi171.stdout:(13/127): libcephfs2-17.0.0-11208.gd3799b8c.el8 4.5 MB/s | 795 kB 00:00 2022-03-21T13:51:41.074 INFO:teuthology.orchestra.run.smithi160.stdout:(4/127): ceph-base-17.0.0-11208.gd3799b8c.el8.x 2.4 MB/s | 5.3 MB 00:02 2022-03-21T13:51:41.103 INFO:teuthology.orchestra.run.smithi171.stdout:(14/127): libcephsqlite-17.0.0-11208.gd3799b8c. 3.3 MB/s | 170 kB 00:00 2022-03-21T13:51:41.164 INFO:teuthology.orchestra.run.smithi171.stdout:(15/127): librados-devel-17.0.0-11208.gd3799b8c 2.0 MB/s | 125 kB 00:00 2022-03-21T13:51:41.244 INFO:teuthology.orchestra.run.smithi171.stdout:(16/127): libradosstriper1-17.0.0-11208.gd3799b 5.9 MB/s | 483 kB 00:00 2022-03-21T13:51:41.571 INFO:teuthology.orchestra.run.smithi160.stdout:(5/127): ceph-mgr-17.0.0-11208.gd3799b8c.el8.x8 3.1 MB/s | 1.5 MB 00:00 2022-03-21T13:51:41.740 INFO:teuthology.orchestra.run.smithi171.stdout:(17/127): ceph-osd-17.0.0-11208.gd3799b8c.el8.x 6.6 MB/s | 17 MB 00:02 2022-03-21T13:51:41.762 INFO:teuthology.orchestra.run.smithi171.stdout:(18/127): librgw2-17.0.0-11208.gd3799b8c.el8.x8 7.7 MB/s | 4.0 MB 00:00 2022-03-21T13:51:41.798 INFO:teuthology.orchestra.run.smithi171.stdout:(19/127): python3-ceph-argparse-17.0.0-11208.gd 775 kB/s | 45 kB 00:00 2022-03-21T13:51:41.807 INFO:teuthology.orchestra.run.smithi160.stdout:(6/127): ceph-mds-17.0.0-11208.gd3799b8c.el8.x8 1.5 MB/s | 2.3 MB 00:01 2022-03-21T13:51:41.808 INFO:teuthology.orchestra.run.smithi171.stdout:(20/127): python3-ceph-common-17.0.0-11208.gd37 2.2 MB/s | 105 kB 00:00 2022-03-21T13:51:41.847 INFO:teuthology.orchestra.run.smithi171.stdout:(21/127): python3-cephfs-17.0.0-11208.gd3799b8c 3.5 MB/s | 179 kB 00:00 2022-03-21T13:51:41.874 INFO:teuthology.orchestra.run.smithi171.stdout:(22/127): python3-rados-17.0.0-11208.gd3799b8c. 5.5 MB/s | 366 kB 00:00 2022-03-21T13:51:41.906 INFO:teuthology.orchestra.run.smithi171.stdout:(23/127): python3-rbd-17.0.0-11208.gd3799b8c.el 5.7 MB/s | 345 kB 00:00 2022-03-21T13:51:41.922 INFO:teuthology.orchestra.run.smithi171.stdout:(24/127): python3-rgw-17.0.0-11208.gd3799b8c.el 2.2 MB/s | 109 kB 00:00 2022-03-21T13:51:41.955 INFO:teuthology.orchestra.run.smithi171.stdout:(25/127): rbd-fuse-17.0.0-11208.gd3799b8c.el8.x 1.9 MB/s | 94 kB 00:00 2022-03-21T13:51:42.026 INFO:teuthology.orchestra.run.smithi171.stdout:(26/127): rbd-nbd-17.0.0-11208.gd3799b8c.el8.x8 2.4 MB/s | 174 kB 00:00 2022-03-21T13:51:42.090 INFO:teuthology.orchestra.run.smithi171.stdout:(27/127): ceph-grafana-dashboards-17.0.0-11208. 356 kB/s | 23 kB 00:00 2022-03-21T13:51:42.158 INFO:teuthology.orchestra.run.smithi171.stdout:(28/127): ceph-mgr-cephadm-17.0.0-11208.gd3799b 1.5 MB/s | 104 kB 00:00 2022-03-21T13:51:42.364 INFO:teuthology.orchestra.run.smithi171.stdout:(29/127): rbd-mirror-17.0.0-11208.gd3799b8c.el8 8.5 MB/s | 3.8 MB 00:00 2022-03-21T13:51:42.411 INFO:teuthology.orchestra.run.smithi171.stdout:(30/127): ceph-mgr-dashboard-17.0.0-11208.gd379 6.4 MB/s | 1.6 MB 00:00 2022-03-21T13:51:42.480 INFO:teuthology.orchestra.run.smithi160.stdout:(7/127): ceph-mon-17.0.0-11208.gd3799b8c.el8.x8 4.3 MB/s | 3.9 MB 00:00 2022-03-21T13:51:42.484 INFO:teuthology.orchestra.run.smithi171.stdout:(31/127): ceph-mgr-modules-core-17.0.0-11208.gd 3.0 MB/s | 226 kB 00:00 2022-03-21T13:51:42.551 INFO:teuthology.orchestra.run.smithi171.stdout:(32/127): ceph-mgr-rook-17.0.0-11208.gd3799b8c. 708 kB/s | 47 kB 00:00 2022-03-21T13:51:42.615 INFO:teuthology.orchestra.run.smithi171.stdout:(33/127): ceph-prometheus-alerts-17.0.0-11208.g 229 kB/s | 15 kB 00:00 2022-03-21T13:51:42.693 INFO:teuthology.orchestra.run.smithi171.stdout:(34/127): ceph-volume-17.0.0-11208.gd3799b8c.el 3.2 MB/s | 257 kB 00:00 2022-03-21T13:51:42.760 INFO:teuthology.orchestra.run.smithi171.stdout:(35/127): cephadm-17.0.0-11208.gd3799b8c.el8.no 1.0 MB/s | 71 kB 00:00 2022-03-21T13:51:42.828 INFO:teuthology.orchestra.run.smithi171.stdout:(36/127): cephfs-top-17.0.0-11208.gd3799b8c.el8 208 kB/s | 14 kB 00:00 2022-03-21T13:51:43.109 INFO:teuthology.orchestra.run.smithi171.stdout:(37/127): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2022-03-21T13:51:43.151 INFO:teuthology.orchestra.run.smithi171.stdout:(38/127): ceph-mgr-diskprediction-local-17.0.0- 9.4 MB/s | 7.4 MB 00:00 2022-03-21T13:51:43.165 INFO:teuthology.orchestra.run.smithi171.stdout:(39/127): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2022-03-21T13:51:43.257 INFO:teuthology.orchestra.run.smithi171.stdout:(40/127): python3-asyncssh-2.7.0-2.el8.noarch.r 5.0 MB/s | 476 kB 00:00 2022-03-21T13:51:43.315 INFO:teuthology.orchestra.run.smithi171.stdout:(41/127): libunwind-1.3.1-3.el8.x86_64.rpm 460 kB/s | 75 kB 00:00 2022-03-21T13:51:43.322 INFO:teuthology.orchestra.run.smithi171.stdout:(42/127): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 670 kB/s | 44 kB 00:00 2022-03-21T13:51:43.360 INFO:teuthology.orchestra.run.smithi171.stdout:(43/127): python3-cachetools-3.1.1-4.el8.noarch 885 kB/s | 33 kB 00:00 2022-03-21T13:51:43.390 INFO:teuthology.orchestra.run.smithi171.stdout:(44/127): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2022-03-21T13:51:43.451 INFO:teuthology.orchestra.run.smithi171.stdout:(45/127): python3-certifi-2018.10.15-7.el8.noar 178 kB/s | 16 kB 00:00 2022-03-21T13:51:43.455 INFO:teuthology.orchestra.run.smithi171.stdout:(46/127): python3-cheroot-8.5.2-1.el8.noarch.rp 2.6 MB/s | 173 kB 00:00 2022-03-21T13:51:43.496 INFO:teuthology.orchestra.run.smithi171.stdout:(47/127): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2022-03-21T13:51:43.529 INFO:teuthology.orchestra.run.smithi171.stdout:(48/127): python3-cherrypy-18.4.0-1.el8.noarch. 4.8 MB/s | 384 kB 00:00 2022-03-21T13:51:43.534 INFO:teuthology.orchestra.run.smithi171.stdout:(49/127): python3-jaraco-6.2-6.el8.noarch.rpm 296 kB/s | 11 kB 00:00 2022-03-21T13:51:43.567 INFO:teuthology.orchestra.run.smithi171.stdout:(50/127): python3-jaraco-functools-2.0-4.el8.no 470 kB/s | 18 kB 00:00 2022-03-21T13:51:43.605 INFO:teuthology.orchestra.run.smithi171.stdout:(51/127): python3-logutils-0.3.5-11.el8.noarch. 1.3 MB/s | 49 kB 00:00 2022-03-21T13:51:43.658 INFO:teuthology.orchestra.run.smithi171.stdout:(52/127): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2022-03-21T13:51:43.699 INFO:teuthology.orchestra.run.smithi171.stdout:(53/127): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2022-03-21T13:51:43.730 INFO:teuthology.orchestra.run.smithi171.stdout:(54/127): python3-kubernetes-11.0.0-6.el8.noarc 6.0 MB/s | 1.2 MB 00:00 2022-03-21T13:51:43.741 INFO:teuthology.orchestra.run.smithi171.stdout:(55/127): python3-pecan-1.3.2-9.el8.noarch.rpm 6.5 MB/s | 283 kB 00:00 2022-03-21T13:51:43.771 INFO:teuthology.orchestra.run.smithi171.stdout:(56/127): python3-portend-2.6-1.el8.noarch.rpm 377 kB/s | 16 kB 00:00 2022-03-21T13:51:43.780 INFO:teuthology.orchestra.run.smithi171.stdout:(57/127): python3-repoze-lru-0.7-6.el8.noarch.r 865 kB/s | 34 kB 00:00 2022-03-21T13:51:43.810 INFO:teuthology.orchestra.run.smithi171.stdout:(58/127): python3-routes-2.4.1-12.el8.noarch.rp 5.0 MB/s | 196 kB 00:00 2022-03-21T13:51:43.827 INFO:teuthology.orchestra.run.smithi171.stdout:(59/127): python3-rsa-4.8-1.el8.noarch.rpm 1.3 MB/s | 61 kB 00:00 2022-03-21T13:51:43.849 INFO:teuthology.orchestra.run.smithi171.stdout:(60/127): python3-simplegeneric-0.8.1-17.el8.no 486 kB/s | 19 kB 00:00 2022-03-21T13:51:43.866 INFO:teuthology.orchestra.run.smithi171.stdout:(61/127): python3-singledispatch-3.4.0.3-18.el8 614 kB/s | 24 kB 00:00 2022-03-21T13:51:43.887 INFO:teuthology.orchestra.run.smithi171.stdout:(62/127): python3-tempora-1.14.1-5.el8.noarch.r 774 kB/s | 29 kB 00:00 2022-03-21T13:51:43.915 INFO:teuthology.orchestra.run.smithi171.stdout:(63/127): python3-trustme-0.6.0-4.el8.noarch.rp 559 kB/s | 27 kB 00:00 2022-03-21T13:51:43.934 INFO:teuthology.orchestra.run.smithi171.stdout:(64/127): python3-waitress-1.2.1-2.el8.1.noarch 5.0 MB/s | 241 kB 00:00 2022-03-21T13:51:43.958 INFO:teuthology.orchestra.run.smithi171.stdout:(65/127): python3-webob-1.8.5-1.el8.1.noarch.rp 5.9 MB/s | 251 kB 00:00 2022-03-21T13:51:43.974 INFO:teuthology.orchestra.run.smithi171.stdout:(66/127): python3-websocket-client-0.56.0-5.el8 1.5 MB/s | 61 kB 00:00 2022-03-21T13:51:43.997 INFO:teuthology.orchestra.run.smithi171.stdout:(67/127): python3-webtest-2.0.33-1.el8.noarch.r 2.1 MB/s | 85 kB 00:00 2022-03-21T13:51:44.012 INFO:teuthology.orchestra.run.smithi171.stdout:(68/127): python3-zc-lockfile-2.0-2.el8.noarch. 603 kB/s | 23 kB 00:00 2022-03-21T13:51:44.046 INFO:teuthology.orchestra.run.smithi171.stdout:(69/127): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2022-03-21T13:51:44.047 INFO:teuthology.orchestra.run.smithi171.stdout:(70/127): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2022-03-21T13:51:44.076 INFO:teuthology.orchestra.run.smithi160.stdout:(8/127): ceph-radosgw-17.0.0-11208.gd3799b8c.el 5.8 MB/s | 9.3 MB 00:01 2022-03-21T13:51:44.076 INFO:teuthology.orchestra.run.smithi171.stdout:(71/127): libaio-devel-0.3.112-1.el8.x86_64.rpm 622 kB/s | 19 kB 00:00 2022-03-21T13:51:44.085 INFO:teuthology.orchestra.run.smithi171.stdout:(72/127): python3-requests-oauthlib-1.0.0-1.el8 1.1 MB/s | 43 kB 00:00 2022-03-21T13:51:44.105 INFO:teuthology.orchestra.run.smithi171.stdout:(73/127): libquadmath-8.4.1-1.el8.x86_64.rpm 6.0 MB/s | 169 kB 00:00 2022-03-21T13:51:44.110 INFO:teuthology.orchestra.run.smithi160.stdout:(9/127): ceph-selinux-17.0.0-11208.gd3799b8c.el 712 kB/s | 24 kB 00:00 2022-03-21T13:51:44.113 INFO:teuthology.orchestra.run.smithi171.stdout:(74/127): python3-cffi-1.11.5-5.el8.x86_64.rpm 8.1 MB/s | 238 kB 00:00 2022-03-21T13:51:44.485 INFO:teuthology.orchestra.run.smithi171.stdout:(75/127): ceph-test-17.0.0-11208.gd3799b8c.el8. 11 MB/s | 45 MB 00:04 2022-03-21T13:51:44.487 INFO:teuthology.orchestra.run.smithi171.stdout:(76/127): elfutils-libelf-devel-0.182-3.el8.x86 157 kB/s | 59 kB 00:00 2022-03-21T13:51:44.496 INFO:teuthology.orchestra.run.smithi171.stdout:(77/127): libgfortran-8.4.1-1.el8.x86_64.rpm 1.6 MB/s | 639 kB 00:00 2022-03-21T13:51:44.521 INFO:teuthology.orchestra.run.smithi171.stdout:(78/127): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2022-03-21T13:51:44.533 INFO:teuthology.orchestra.run.smithi171.stdout:(79/127): libselinux-devel-2.9-5.el8.x86_64.rpm 4.1 MB/s | 200 kB 00:00 2022-03-21T13:51:44.535 INFO:teuthology.orchestra.run.smithi171.stdout:(80/127): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.4 MB/s | 229 kB 00:00 2022-03-21T13:51:44.555 INFO:teuthology.orchestra.run.smithi171.stdout:(81/127): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2022-03-21T13:51:44.566 INFO:teuthology.orchestra.run.smithi171.stdout:(82/127): libverto-devel-0.3.0-5.el8.x86_64.rpm 545 kB/s | 18 kB 00:00 2022-03-21T13:51:44.577 INFO:teuthology.orchestra.run.smithi171.stdout:(83/127): libsepol-devel-2.9-2.el8.x86_64.rpm 2.5 MB/s | 86 kB 00:00 2022-03-21T13:51:44.588 INFO:teuthology.orchestra.run.smithi171.stdout:(84/127): libuuid-devel-2.32.1-27.el8.x86_64.rp 2.9 MB/s | 97 kB 00:00 2022-03-21T13:51:44.599 INFO:teuthology.orchestra.run.smithi171.stdout:(85/127): python3-oauthlib-2.1.0-1.el8.noarch.r 4.7 MB/s | 155 kB 00:00 2022-03-21T13:51:44.616 INFO:teuthology.orchestra.run.smithi171.stdout:(86/127): fuse-2.9.7-12.el8.x86_64.rpm 2.8 MB/s | 83 kB 00:00 2022-03-21T13:51:44.624 INFO:teuthology.orchestra.run.smithi171.stdout:(87/127): python3-pycparser-2.14-14.el8.noarch. 4.2 MB/s | 109 kB 00:00 2022-03-21T13:51:44.647 INFO:teuthology.orchestra.run.smithi171.stdout:(88/127): openssl-devel-1.1.1g-15.el8_3.x86_64. 33 MB/s | 2.3 MB 00:00 2022-03-21T13:51:44.656 INFO:teuthology.orchestra.run.smithi171.stdout:(89/127): pcre2-devel-10.32-2.el8.x86_64.rpm 15 MB/s | 605 kB 00:00 2022-03-21T13:51:44.658 INFO:teuthology.orchestra.run.smithi171.stdout:(90/127): python3-cryptography-3.2.1-4.el8.x86_ 16 MB/s | 559 kB 00:00 2022-03-21T13:51:44.672 INFO:teuthology.orchestra.run.smithi171.stdout:(91/127): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2022-03-21T13:51:44.688 INFO:teuthology.orchestra.run.smithi171.stdout:(92/127): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.8 MB/s | 48 kB 00:00 2022-03-21T13:51:44.689 INFO:teuthology.orchestra.run.smithi171.stdout:(93/127): pcre2-utf32-10.32-2.el8.x86_64.rpm 6.5 MB/s | 220 kB 00:00 2022-03-21T13:51:44.708 INFO:teuthology.orchestra.run.smithi171.stdout:(94/127): libcom_err-devel-1.45.6-1.el8.x86_64. 1.1 MB/s | 38 kB 00:00 2022-03-21T13:51:44.722 INFO:teuthology.orchestra.run.smithi171.stdout:(95/127): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 16 MB/s | 559 kB 00:00 2022-03-21T13:51:44.727 INFO:teuthology.orchestra.run.smithi171.stdout:(96/127): python3-mako-1.0.6-13.el8.noarch.rpm 4.1 MB/s | 157 kB 00:00 2022-03-21T13:51:44.748 INFO:teuthology.orchestra.run.smithi171.stdout:(97/127): flex-2.6.1-9.el8.x86_64.rpm 7.9 MB/s | 320 kB 00:00 2022-03-21T13:51:44.750 INFO:teuthology.orchestra.run.smithi171.stdout:(98/127): jq-1.5-12.el8.x86_64.rpm 6.5 MB/s | 161 kB 00:00 2022-03-21T13:51:44.755 INFO:teuthology.orchestra.run.smithi171.stdout:(99/127): python3-jsonpatch-1.21-2.el8.noarch.r 971 kB/s | 27 kB 00:00 2022-03-21T13:51:44.782 INFO:teuthology.orchestra.run.smithi171.stdout:(100/127): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2022-03-21T13:51:44.789 INFO:teuthology.orchestra.run.smithi171.stdout:(101/127): python3-jinja2-2.10.1-2.el8_0.noarch 15 MB/s | 538 kB 00:00 2022-03-21T13:51:44.802 INFO:teuthology.orchestra.run.smithi171.stdout:(102/127): automake-1.16.1-7.el8.noarch.rpm 15 MB/s | 713 kB 00:00 2022-03-21T13:51:44.817 INFO:teuthology.orchestra.run.smithi171.stdout:(103/127): libtool-2.4.6-25.el8.x86_64.rpm 20 MB/s | 709 kB 00:00 2022-03-21T13:51:44.829 INFO:teuthology.orchestra.run.smithi171.stdout:(104/127): python3-pyasn1-modules-0.3.7-6.el8.n 4.8 MB/s | 110 kB 00:00 2022-03-21T13:51:44.840 INFO:teuthology.orchestra.run.smithi171.stdout:(105/127): python3-jsonpointer-1.10-11.el8.noar 1.0 MB/s | 20 kB 00:00 2022-03-21T13:51:44.857 INFO:teuthology.orchestra.run.smithi171.stdout:(106/127): python3-pytz-2017.2-9.el8.noarch.rpm 1.9 MB/s | 54 kB 00:00 2022-03-21T13:51:44.865 INFO:teuthology.orchestra.run.smithi171.stdout:(107/127): oniguruma-6.8.2-2.el8.x86_64.rpm 7.4 MB/s | 187 kB 00:00 2022-03-21T13:51:44.880 INFO:teuthology.orchestra.run.smithi171.stdout:(108/127): python3-numpy-1.14.3-9.el8.x86_64.rp 41 MB/s | 3.7 MB 00:00 2022-03-21T13:51:44.885 INFO:teuthology.orchestra.run.smithi171.stdout:(109/127): python3-pyasn1-0.3.7-6.el8.noarch.rp 4.4 MB/s | 126 kB 00:00 2022-03-21T13:51:44.913 INFO:teuthology.orchestra.run.smithi171.stdout:(110/127): python3-pyOpenSSL-19.0.0-1.el8.noarc 3.5 MB/s | 103 kB 00:00 2022-03-21T13:51:44.922 INFO:teuthology.orchestra.run.smithi171.stdout:(111/127): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.0 MB/s | 259 kB 00:00 2022-03-21T13:51:44.980 INFO:teuthology.orchestra.run.smithi171.stdout:(112/127): openblas-threads-0.3.12-1.el8.x86_64 71 MB/s | 4.7 MB 00:00 2022-03-21T13:51:45.011 INFO:teuthology.orchestra.run.smithi171.stdout:(113/127): python3-babel-2.5.1-5.el8.noarch.rpm 56 MB/s | 4.8 MB 00:00 2022-03-21T13:51:45.020 INFO:teuthology.orchestra.run.smithi171.stdout:(114/127): python3-werkzeug-0.12.2-4.el8.noarch 12 MB/s | 457 kB 00:00 2022-03-21T13:51:45.036 INFO:teuthology.orchestra.run.smithi171.stdout:(115/127): python3-markupsafe-0.23-19.el8.x86_6 1.5 MB/s | 39 kB 00:00 2022-03-21T13:51:45.043 INFO:teuthology.orchestra.run.smithi171.stdout:(116/127): python3-prettytable-0.7.2-14.el8.noa 1.8 MB/s | 44 kB 00:00 2022-03-21T13:51:45.062 INFO:teuthology.orchestra.run.smithi171.stdout:(117/127): socat-1.7.3.3-2.el8.x86_64.rpm 11 MB/s | 302 kB 00:00 2022-03-21T13:51:45.201 INFO:teuthology.orchestra.run.smithi171.stdout:(118/127): python3-scipy-1.0.0-20.module+el8.1. 43 MB/s | 15 MB 00:00 2022-03-21T13:51:45.212 INFO:teuthology.orchestra.run.smithi171.stdout:(119/127): bison-3.0.4-10.el8.x86_64.rpm 4.5 MB/s | 688 kB 00:00 2022-03-21T13:51:45.225 INFO:teuthology.orchestra.run.smithi171.stdout:(120/127): python3-numpy-f2py-1.14.3-9.el8.x86_ 9.3 MB/s | 225 kB 00:00 2022-03-21T13:51:45.239 INFO:teuthology.orchestra.run.smithi171.stdout:(121/127): openblas-0.3.12-1.el8.x86_64.rpm 24 MB/s | 4.6 MB 00:00 2022-03-21T13:51:45.260 INFO:teuthology.orchestra.run.smithi171.stdout:(122/127): NetworkManager-team-1.30.0-13.el8_4. 6.9 MB/s | 146 kB 00:00 2022-03-21T13:51:45.290 INFO:teuthology.orchestra.run.smithi171.stdout:(123/127): NetworkManager-libnm-1.30.0-13.el8_4 59 MB/s | 1.8 MB 00:00 2022-03-21T13:51:45.311 INFO:teuthology.orchestra.run.smithi171.stdout:(124/127): NetworkManager-tui-1.30.0-13.el8_4.x 15 MB/s | 329 kB 00:00 2022-03-21T13:51:45.346 INFO:teuthology.orchestra.run.smithi171.stdout:(125/127): NetworkManager-1.30.0-13.el8_4.x86_6 74 MB/s | 2.6 MB 00:00 2022-03-21T13:51:45.753 INFO:teuthology.orchestra.run.smithi171.stdout:(126/127): librados2-17.0.0-11208.gd3799b8c.el8 6.4 MB/s | 3.4 MB 00:00 2022-03-21T13:51:45.766 INFO:teuthology.orchestra.run.smithi171.stdout:(127/127): librbd1-17.0.0-11208.gd3799b8c.el8.x 7.1 MB/s | 3.9 MB 00:00 2022-03-21T13:51:45.769 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2022-03-21T13:51:45.770 INFO:teuthology.orchestra.run.smithi171.stdout:Total 25 MB/s | 187 MB 00:07 2022-03-21T13:51:45.825 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2022-03-21T13:51:45.948 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2022-03-21T13:51:45.949 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2022-03-21T13:51:46.835 INFO:teuthology.orchestra.run.smithi160.stdout:(10/127): ceph-common-17.0.0-11208.gd3799b8c.el 2.6 MB/s | 20 MB 00:07 2022-03-21T13:51:46.952 INFO:teuthology.orchestra.run.smithi160.stdout:(11/127): ceph-osd-17.0.0-11208.gd3799b8c.el8.x 3.3 MB/s | 17 MB 00:05 2022-03-21T13:51:46.961 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2022-03-21T13:51:46.962 INFO:teuthology.orchestra.run.smithi160.stdout:(12/127): cephfs-mirror-17.0.0-11208.gd3799b8c. 2.1 MB/s | 273 kB 00:00 2022-03-21T13:51:46.965 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2022-03-21T13:51:46.995 INFO:teuthology.orchestra.run.smithi160.stdout:(13/127): libcephfs-devel-17.0.0-11208.gd3799b8 586 kB/s | 25 kB 00:00 2022-03-21T13:51:47.036 INFO:teuthology.orchestra.run.smithi160.stdout:(14/127): libcephsqlite-17.0.0-11208.gd3799b8c. 4.0 MB/s | 170 kB 00:00 2022-03-21T13:51:47.083 INFO:teuthology.orchestra.run.smithi160.stdout:(15/127): librados-devel-17.0.0-11208.gd3799b8c 2.6 MB/s | 125 kB 00:00 2022-03-21T13:51:47.197 INFO:teuthology.orchestra.run.smithi160.stdout:(16/127): libcephfs2-17.0.0-11208.gd3799b8c.el8 3.3 MB/s | 795 kB 00:00 2022-03-21T13:51:47.229 INFO:teuthology.orchestra.run.smithi160.stdout:(17/127): libradosstriper1-17.0.0-11208.gd3799b 3.2 MB/s | 483 kB 00:00 2022-03-21T13:51:47.281 INFO:teuthology.orchestra.run.smithi160.stdout:(18/127): python3-ceph-argparse-17.0.0-11208.gd 861 kB/s | 45 kB 00:00 2022-03-21T13:51:47.332 INFO:teuthology.orchestra.run.smithi160.stdout:(19/127): python3-ceph-common-17.0.0-11208.gd37 2.0 MB/s | 105 kB 00:00 2022-03-21T13:51:47.385 INFO:teuthology.orchestra.run.smithi160.stdout:(20/127): python3-cephfs-17.0.0-11208.gd3799b8c 3.3 MB/s | 179 kB 00:00 2022-03-21T13:51:47.487 INFO:teuthology.orchestra.run.smithi160.stdout:(21/127): python3-rados-17.0.0-11208.gd3799b8c. 3.6 MB/s | 366 kB 00:00 2022-03-21T13:51:47.592 INFO:teuthology.orchestra.run.smithi160.stdout:(22/127): python3-rbd-17.0.0-11208.gd3799b8c.el 3.2 MB/s | 345 kB 00:00 2022-03-21T13:51:47.643 INFO:teuthology.orchestra.run.smithi160.stdout:(23/127): python3-rgw-17.0.0-11208.gd3799b8c.el 2.1 MB/s | 109 kB 00:00 2022-03-21T13:51:47.705 INFO:teuthology.orchestra.run.smithi160.stdout:(24/127): rbd-fuse-17.0.0-11208.gd3799b8c.el8.x 1.5 MB/s | 94 kB 00:00 2022-03-21T13:51:48.236 INFO:teuthology.orchestra.run.smithi160.stdout:(25/127): librgw2-17.0.0-11208.gd3799b8c.el8.x8 3.8 MB/s | 4.0 MB 00:01 2022-03-21T13:51:48.282 INFO:teuthology.orchestra.run.smithi160.stdout:(26/127): rbd-nbd-17.0.0-11208.gd3799b8c.el8.x8 3.8 MB/s | 174 kB 00:00 2022-03-21T13:51:48.328 INFO:teuthology.orchestra.run.smithi160.stdout:(27/127): ceph-grafana-dashboards-17.0.0-11208. 490 kB/s | 23 kB 00:00 2022-03-21T13:51:48.377 INFO:teuthology.orchestra.run.smithi160.stdout:(28/127): ceph-mgr-cephadm-17.0.0-11208.gd3799b 2.1 MB/s | 104 kB 00:00 2022-03-21T13:51:48.690 INFO:teuthology.orchestra.run.smithi160.stdout:(29/127): rbd-mirror-17.0.0-11208.gd3799b8c.el8 3.8 MB/s | 3.8 MB 00:00 2022-03-21T13:51:48.818 INFO:teuthology.orchestra.run.smithi160.stdout:(30/127): ceph-mgr-dashboard-17.0.0-11208.gd379 3.7 MB/s | 1.6 MB 00:00 2022-03-21T13:51:48.925 INFO:teuthology.orchestra.run.smithi160.stdout:(31/127): ceph-mgr-modules-core-17.0.0-11208.gd 2.1 MB/s | 226 kB 00:00 2022-03-21T13:51:48.980 INFO:teuthology.orchestra.run.smithi160.stdout:(32/127): ceph-mgr-rook-17.0.0-11208.gd3799b8c. 852 kB/s | 47 kB 00:00 2022-03-21T13:51:49.034 INFO:teuthology.orchestra.run.smithi160.stdout:(33/127): ceph-prometheus-alerts-17.0.0-11208.g 270 kB/s | 15 kB 00:00 2022-03-21T13:51:49.136 INFO:teuthology.orchestra.run.smithi160.stdout:(34/127): ceph-volume-17.0.0-11208.gd3799b8c.el 2.5 MB/s | 257 kB 00:00 2022-03-21T13:51:49.183 INFO:teuthology.orchestra.run.smithi160.stdout:(35/127): cephadm-17.0.0-11208.gd3799b8c.el8.no 1.5 MB/s | 71 kB 00:00 2022-03-21T13:51:49.230 INFO:teuthology.orchestra.run.smithi160.stdout:(36/127): cephfs-top-17.0.0-11208.gd3799b8c.el8 307 kB/s | 14 kB 00:00 2022-03-21T13:51:49.533 INFO:teuthology.orchestra.run.smithi160.stdout:(37/127): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2022-03-21T13:51:49.585 INFO:teuthology.orchestra.run.smithi160.stdout:(38/127): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2022-03-21T13:51:49.639 INFO:teuthology.orchestra.run.smithi160.stdout:(39/127): libunwind-1.3.1-3.el8.x86_64.rpm 1.4 MB/s | 75 kB 00:00 2022-03-21T13:51:49.981 INFO:teuthology.orchestra.run.smithi160.stdout:(40/127): ceph-test-17.0.0-11208.gd3799b8c.el8. 7.7 MB/s | 45 MB 00:05 2022-03-21T13:51:49.985 INFO:teuthology.orchestra.run.smithi160.stdout:(41/127): python3-asyncssh-2.7.0-2.el8.noarch.r 1.3 MB/s | 476 kB 00:00 2022-03-21T13:51:50.040 INFO:teuthology.orchestra.run.smithi160.stdout:(42/127): python3-beautifulsoup4-4.6.3-2.el8.1. 3.3 MB/s | 185 kB 00:00 2022-03-21T13:51:50.096 INFO:teuthology.orchestra.run.smithi160.stdout:(43/127): python3-cachetools-3.1.1-4.el8.noarch 592 kB/s | 33 kB 00:00 2022-03-21T13:51:50.154 INFO:teuthology.orchestra.run.smithi160.stdout:(44/127): python3-certifi-2018.10.15-7.el8.noar 282 kB/s | 16 kB 00:00 2022-03-21T13:51:50.201 INFO:teuthology.orchestra.run.smithi160.stdout:(45/127): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 198 kB/s | 44 kB 00:00 2022-03-21T13:51:50.215 INFO:teuthology.orchestra.run.smithi160.stdout:(46/127): python3-cheroot-8.5.2-1.el8.noarch.rp 2.8 MB/s | 173 kB 00:00 2022-03-21T13:51:50.271 INFO:teuthology.orchestra.run.smithi160.stdout:(47/127): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2022-03-21T13:51:50.322 INFO:teuthology.orchestra.run.smithi160.stdout:(48/127): python3-jaraco-6.2-6.el8.noarch.rpm 219 kB/s | 11 kB 00:00 2022-03-21T13:51:50.376 INFO:teuthology.orchestra.run.smithi160.stdout:(49/127): python3-jaraco-functools-2.0-4.el8.no 331 kB/s | 18 kB 00:00 2022-03-21T13:51:50.413 INFO:teuthology.orchestra.run.smithi160.stdout:(50/127): python3-cherrypy-18.4.0-1.el8.noarch. 1.8 MB/s | 384 kB 00:00 2022-03-21T13:51:50.465 INFO:teuthology.orchestra.run.smithi160.stdout:(51/127): python3-logutils-0.3.5-11.el8.noarch. 941 kB/s | 49 kB 00:00 2022-03-21T13:51:50.520 INFO:teuthology.orchestra.run.smithi160.stdout:(52/127): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2022-03-21T13:51:50.558 INFO:teuthology.orchestra.run.smithi160.stdout:(53/127): ceph-mgr-diskprediction-local-17.0.0- 4.0 MB/s | 7.4 MB 00:01 2022-03-21T13:51:50.577 INFO:teuthology.orchestra.run.smithi160.stdout:(54/127): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2022-03-21T13:51:50.628 INFO:teuthology.orchestra.run.smithi160.stdout:(55/127): python3-portend-2.6-1.el8.noarch.rpm 303 kB/s | 16 kB 00:00 2022-03-21T13:51:50.642 INFO:teuthology.orchestra.run.smithi160.stdout:(56/127): python3-kubernetes-11.0.0-6.el8.noarc 4.4 MB/s | 1.2 MB 00:00 2022-03-21T13:51:50.671 INFO:teuthology.orchestra.run.smithi160.stdout:(57/127): python3-repoze-lru-0.7-6.el8.noarch.r 794 kB/s | 34 kB 00:00 2022-03-21T13:51:50.688 INFO:teuthology.orchestra.run.smithi160.stdout:(58/127): python3-routes-2.4.1-12.el8.noarch.rp 4.1 MB/s | 196 kB 00:00 2022-03-21T13:51:50.712 INFO:teuthology.orchestra.run.smithi160.stdout:(59/127): python3-rsa-4.8-1.el8.noarch.rpm 1.5 MB/s | 61 kB 00:00 2022-03-21T13:51:50.730 INFO:teuthology.orchestra.run.smithi160.stdout:(60/127): python3-simplegeneric-0.8.1-17.el8.no 454 kB/s | 19 kB 00:00 2022-03-21T13:51:50.750 INFO:teuthology.orchestra.run.smithi160.stdout:(61/127): python3-singledispatch-3.4.0.3-18.el8 629 kB/s | 24 kB 00:00 2022-03-21T13:51:50.766 INFO:teuthology.orchestra.run.smithi160.stdout:(62/127): python3-tempora-1.14.1-5.el8.noarch.r 813 kB/s | 29 kB 00:00 2022-03-21T13:51:50.786 INFO:teuthology.orchestra.run.smithi160.stdout:(63/127): python3-trustme-0.6.0-4.el8.noarch.rp 778 kB/s | 27 kB 00:00 2022-03-21T13:51:50.801 INFO:teuthology.orchestra.run.smithi160.stdout:(64/127): python3-waitress-1.2.1-2.el8.1.noarch 6.7 MB/s | 241 kB 00:00 2022-03-21T13:51:50.814 INFO:teuthology.orchestra.run.smithi160.stdout:(65/127): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2022-03-21T13:51:50.841 INFO:teuthology.orchestra.run.smithi160.stdout:(66/127): python3-websocket-client-0.56.0-5.el8 1.5 MB/s | 61 kB 00:00 2022-03-21T13:51:50.855 INFO:teuthology.orchestra.run.smithi160.stdout:(67/127): python3-webtest-2.0.33-1.el8.noarch.r 2.1 MB/s | 85 kB 00:00 2022-03-21T13:51:50.878 INFO:teuthology.orchestra.run.smithi160.stdout:(68/127): python3-zc-lockfile-2.0-2.el8.noarch. 629 kB/s | 23 kB 00:00 2022-03-21T13:51:50.890 INFO:teuthology.orchestra.run.smithi160.stdout:(69/127): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.9 MB/s | 69 kB 00:00 2022-03-21T13:51:50.901 INFO:teuthology.orchestra.run.smithi160.stdout:(70/127): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2022-03-21T13:51:50.918 INFO:teuthology.orchestra.run.smithi160.stdout:(71/127): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2022-03-21T13:51:50.934 INFO:teuthology.orchestra.run.smithi160.stdout:(72/127): libaio-devel-0.3.112-1.el8.x86_64.rpm 431 kB/s | 19 kB 00:00 2022-03-21T13:51:50.948 INFO:teuthology.orchestra.run.smithi160.stdout:(73/127): python3-requests-oauthlib-1.0.0-1.el8 933 kB/s | 43 kB 00:00 2022-03-21T13:51:50.959 INFO:teuthology.orchestra.run.smithi160.stdout:(74/127): libquadmath-8.4.1-1.el8.x86_64.rpm 4.1 MB/s | 169 kB 00:00 2022-03-21T13:51:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:(75/127): python3-cffi-1.11.5-5.el8.x86_64.rpm 6.3 MB/s | 238 kB 00:00 2022-03-21T13:51:50.985 INFO:teuthology.orchestra.run.smithi160.stdout:(76/127): libgfortran-8.4.1-1.el8.x86_64.rpm 17 MB/s | 639 kB 00:00 2022-03-21T13:51:50.990 INFO:teuthology.orchestra.run.smithi160.stdout:(77/127): elfutils-libelf-devel-0.182-3.el8.x86 1.9 MB/s | 59 kB 00:00 2022-03-21T13:51:51.001 INFO:teuthology.orchestra.run.smithi160.stdout:(78/127): libselinux-devel-2.9-5.el8.x86_64.rpm 6.5 MB/s | 200 kB 00:00 2022-03-21T13:51:51.016 INFO:teuthology.orchestra.run.smithi160.stdout:(79/127): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.1 MB/s | 58 kB 00:00 2022-03-21T13:51:51.028 INFO:teuthology.orchestra.run.smithi160.stdout:(80/127): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.8 MB/s | 229 kB 00:00 2022-03-21T13:51:51.038 INFO:teuthology.orchestra.run.smithi160.stdout:(81/127): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2022-03-21T13:51:51.049 INFO:teuthology.orchestra.run.smithi160.stdout:(82/127): libverto-devel-0.3.0-5.el8.x86_64.rpm 546 kB/s | 18 kB 00:00 2022-03-21T13:51:51.060 INFO:teuthology.orchestra.run.smithi160.stdout:(83/127): libsepol-devel-2.9-2.el8.x86_64.rpm 2.6 MB/s | 86 kB 00:00 2022-03-21T13:51:51.067 INFO:teuthology.orchestra.run.smithi160.stdout:(84/127): libuuid-devel-2.32.1-27.el8.x86_64.rp 3.3 MB/s | 97 kB 00:00 2022-03-21T13:51:51.082 INFO:teuthology.orchestra.run.smithi160.stdout:(85/127): python3-oauthlib-2.1.0-1.el8.noarch.r 4.5 MB/s | 155 kB 00:00 2022-03-21T13:51:51.100 INFO:teuthology.orchestra.run.smithi160.stdout:(86/127): fuse-2.9.7-12.el8.x86_64.rpm 2.5 MB/s | 83 kB 00:00 2022-03-21T13:51:51.107 INFO:teuthology.orchestra.run.smithi160.stdout:(87/127): python3-pycparser-2.14-14.el8.noarch. 4.3 MB/s | 109 kB 00:00 2022-03-21T13:51:51.125 INFO:teuthology.orchestra.run.smithi160.stdout:(88/127): openssl-devel-1.1.1g-15.el8_3.x86_64. 36 MB/s | 2.3 MB 00:00 2022-03-21T13:51:51.138 INFO:teuthology.orchestra.run.smithi160.stdout:(89/127): pcre2-devel-10.32-2.el8.x86_64.rpm 16 MB/s | 605 kB 00:00 2022-03-21T13:51:51.150 INFO:teuthology.orchestra.run.smithi160.stdout:(90/127): python3-cryptography-3.2.1-4.el8.x86_ 13 MB/s | 559 kB 00:00 2022-03-21T13:51:51.150 INFO:teuthology.orchestra.run.smithi160.stdout:(91/127): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2022-03-21T13:51:51.171 INFO:teuthology.orchestra.run.smithi160.stdout:(92/127): pcre2-utf32-10.32-2.el8.x86_64.rpm 6.6 MB/s | 220 kB 00:00 2022-03-21T13:51:51.177 INFO:teuthology.orchestra.run.smithi160.stdout:(93/127): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.8 MB/s | 48 kB 00:00 2022-03-21T13:51:51.182 INFO:teuthology.orchestra.run.smithi160.stdout:(94/127): libcom_err-devel-1.45.6-1.el8.x86_64. 1.2 MB/s | 38 kB 00:00 2022-03-21T13:51:51.209 INFO:teuthology.orchestra.run.smithi160.stdout:(95/127): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 16 MB/s | 559 kB 00:00 2022-03-21T13:51:51.210 INFO:teuthology.orchestra.run.smithi160.stdout:(96/127): python3-mako-1.0.6-13.el8.noarch.rpm 4.5 MB/s | 157 kB 00:00 2022-03-21T13:51:51.222 INFO:teuthology.orchestra.run.smithi160.stdout:(97/127): flex-2.6.1-9.el8.x86_64.rpm 7.8 MB/s | 320 kB 00:00 2022-03-21T13:51:51.237 INFO:teuthology.orchestra.run.smithi160.stdout:(98/127): jq-1.5-12.el8.x86_64.rpm 5.6 MB/s | 161 kB 00:00 2022-03-21T13:51:51.238 INFO:teuthology.orchestra.run.smithi160.stdout:(99/127): python3-jsonpatch-1.21-2.el8.noarch.r 968 kB/s | 27 kB 00:00 2022-03-21T13:51:51.262 INFO:teuthology.orchestra.run.smithi160.stdout:(100/127): librdkafka-0.11.4-1.el8.x86_64.rpm 8.7 MB/s | 353 kB 00:00 2022-03-21T13:51:51.272 INFO:teuthology.orchestra.run.smithi160.stdout:(101/127): python3-jinja2-2.10.1-2.el8_0.noarch 15 MB/s | 538 kB 00:00 2022-03-21T13:51:51.280 INFO:teuthology.orchestra.run.smithi160.stdout:(102/127): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2022-03-21T13:51:51.298 INFO:teuthology.orchestra.run.smithi160.stdout:(103/127): libtool-2.4.6-25.el8.x86_64.rpm 20 MB/s | 709 kB 00:00 2022-03-21T13:51:51.309 INFO:teuthology.orchestra.run.smithi160.stdout:(104/127): python3-pyasn1-modules-0.3.7-6.el8.n 4.4 MB/s | 110 kB 00:00 2022-03-21T13:51:51.326 INFO:teuthology.orchestra.run.smithi160.stdout:(105/127): python3-jsonpointer-1.10-11.el8.noar 833 kB/s | 20 kB 00:00 2022-03-21T13:51:51.334 INFO:teuthology.orchestra.run.smithi160.stdout:(106/127): python3-pytz-2017.2-9.el8.noarch.rpm 2.2 MB/s | 54 kB 00:00 2022-03-21T13:51:51.347 INFO:teuthology.orchestra.run.smithi160.stdout:(107/127): oniguruma-6.8.2-2.el8.x86_64.rpm 8.7 MB/s | 187 kB 00:00 2022-03-21T13:51:51.362 INFO:teuthology.orchestra.run.smithi160.stdout:(108/127): python3-numpy-1.14.3-9.el8.x86_64.rp 44 MB/s | 3.7 MB 00:00 2022-03-21T13:51:51.363 INFO:teuthology.orchestra.run.smithi160.stdout:(109/127): python3-pyasn1-0.3.7-6.el8.noarch.rp 4.3 MB/s | 126 kB 00:00 2022-03-21T13:51:51.393 INFO:teuthology.orchestra.run.smithi160.stdout:(110/127): python3-pyOpenSSL-19.0.0-1.el8.noarc 3.3 MB/s | 103 kB 00:00 2022-03-21T13:51:51.402 INFO:teuthology.orchestra.run.smithi160.stdout:(111/127): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.6 MB/s | 259 kB 00:00 2022-03-21T13:51:51.462 INFO:teuthology.orchestra.run.smithi160.stdout:(112/127): openblas-threads-0.3.12-1.el8.x86_64 69 MB/s | 4.7 MB 00:00 2022-03-21T13:51:51.492 INFO:teuthology.orchestra.run.smithi160.stdout:(113/127): python3-babel-2.5.1-5.el8.noarch.rpm 56 MB/s | 4.8 MB 00:00 2022-03-21T13:51:51.500 INFO:teuthology.orchestra.run.smithi160.stdout:(114/127): python3-werkzeug-0.12.2-4.el8.noarch 12 MB/s | 457 kB 00:00 2022-03-21T13:51:51.518 INFO:teuthology.orchestra.run.smithi160.stdout:(115/127): python3-markupsafe-0.23-19.el8.x86_6 1.4 MB/s | 39 kB 00:00 2022-03-21T13:51:51.526 INFO:teuthology.orchestra.run.smithi160.stdout:(116/127): python3-prettytable-0.7.2-14.el8.noa 1.7 MB/s | 44 kB 00:00 2022-03-21T13:51:51.545 INFO:teuthology.orchestra.run.smithi160.stdout:(117/127): socat-1.7.3.3-2.el8.x86_64.rpm 11 MB/s | 302 kB 00:00 2022-03-21T13:51:51.631 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2022-03-21T13:51:51.659 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2022-03-21T13:51:51.661 INFO:teuthology.orchestra.run.smithi160.stdout:(118/127): python3-scipy-1.0.0-20.module+el8.1. 47 MB/s | 15 MB 00:00 2022-03-21T13:51:51.672 INFO:teuthology.orchestra.run.smithi160.stdout:(119/127): bison-3.0.4-10.el8.x86_64.rpm 5.3 MB/s | 688 kB 00:00 2022-03-21T13:51:51.685 INFO:teuthology.orchestra.run.smithi160.stdout:(120/127): python3-numpy-f2py-1.14.3-9.el8.x86_ 9.6 MB/s | 225 kB 00:00 2022-03-21T13:51:51.697 INFO:teuthology.orchestra.run.smithi160.stdout:(121/127): openblas-0.3.12-1.el8.x86_64.rpm 27 MB/s | 4.6 MB 00:00 2022-03-21T13:51:51.722 INFO:teuthology.orchestra.run.smithi160.stdout:(122/127): NetworkManager-team-1.30.0-13.el8_4. 5.9 MB/s | 146 kB 00:00 2022-03-21T13:51:51.753 INFO:teuthology.orchestra.run.smithi160.stdout:(123/127): NetworkManager-libnm-1.30.0-13.el8_4 58 MB/s | 1.8 MB 00:00 2022-03-21T13:51:51.775 INFO:teuthology.orchestra.run.smithi160.stdout:(124/127): NetworkManager-tui-1.30.0-13.el8_4.x 15 MB/s | 329 kB 00:00 2022-03-21T13:51:51.811 INFO:teuthology.orchestra.run.smithi160.stdout:(125/127): NetworkManager-1.30.0-13.el8_4.x86_6 70 MB/s | 2.6 MB 00:00 2022-03-21T13:51:51.854 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/133 2022-03-21T13:51:52.050 INFO:teuthology.orchestra.run.smithi160.stdout:(126/127): librbd1-17.0.0-11208.gd3799b8c.el8.x 11 MB/s | 3.9 MB 00:00 2022-03-21T13:51:52.052 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/133 2022-03-21T13:51:52.126 INFO:teuthology.orchestra.run.smithi160.stdout:(127/127): librados2-17.0.0-11208.gd3799b8c.el8 7.7 MB/s | 3.4 MB 00:00 2022-03-21T13:51:52.129 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2022-03-21T13:51:52.130 INFO:teuthology.orchestra.run.smithi160.stdout:Total 14 MB/s | 187 MB 00:13 2022-03-21T13:51:52.185 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2022-03-21T13:51:52.309 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2022-03-21T13:51:52.310 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2022-03-21T13:51:52.423 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/133 2022-03-21T13:51:52.660 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:17.0.0-11208.gd3799b8c.el8.x86_64 3/133 2022-03-21T13:51:53.096 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:17.0.0-11208.gd3799b8c.el8.x86_64 3/133 2022-03-21T13:51:53.321 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2022-03-21T13:51:53.325 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2022-03-21T13:51:53.393 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:17.0.0-11208.gd3799b8c.el8.x86_64 4/133 2022-03-21T13:51:53.522 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:17.0.0-11208.gd3799b8c.el8.x86_64 4/133 2022-03-21T13:51:53.719 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:17.0.0-11208.gd3799b8c.el8.x86_64 5/133 2022-03-21T13:51:54.002 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:17.0.0-11208.gd3799b8c.el8.x86_64 5/133 2022-03-21T13:51:54.128 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:17.0.0-11208.gd3799b8c.el8.x86_6 6/133 2022-03-21T13:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 7/133 2022-03-21T13:51:54.346 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 7/133 2022-03-21T13:51:54.879 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/133 2022-03-21T13:51:55.034 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:17.0.0-11208.gd3799b8c.el8.x86_64 9/133 2022-03-21T13:51:55.137 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:17.0.0-11208.gd3799b8c.el8.x86_64 9/133 2022-03-21T13:51:55.322 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/133 2022-03-21T13:51:55.499 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/133 2022-03-21T13:51:55.635 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:17.0.0-11208.gd3799b8c.el8.x86_6 12/133 2022-03-21T13:51:55.740 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:17.0.0-11208.gd3799b8c.el8.x86_6 12/133 2022-03-21T13:51:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:17.0.0-11208.gd3799b8c.el8.x8 13/133 2022-03-21T13:51:56.171 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:17.0.0-11208.gd3799b8c.el8.x8 13/133 2022-03-21T13:51:56.434 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 14/133 2022-03-21T13:51:56.485 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 14/133 2022-03-21T13:51:56.717 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 15/133 2022-03-21T13:51:56.968 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-1:1.30.0-13.el8_4.x86_64 15/133 2022-03-21T13:51:57.293 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 15/133 2022-03-21T13:51:57.526 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/133 2022-03-21T13:51:57.725 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/133 2022-03-21T13:51:57.882 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/133 2022-03-21T13:51:58.014 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 19/133 2022-03-21T13:51:58.116 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2022-03-21T13:51:58.143 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2022-03-21T13:51:58.151 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 20/133 2022-03-21T13:51:58.346 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/133 2022-03-21T13:51:58.569 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/133 2022-03-21T13:51:58.768 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 20/133 2022-03-21T13:51:58.923 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 21/133 2022-03-21T13:51:58.967 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/133 2022-03-21T13:51:59.252 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:17.0.0-11208.gd3799b8c.el8.x86_64 3/133 2022-03-21T13:51:59.464 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 21/133 2022-03-21T13:51:59.592 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 22/133 2022-03-21T13:51:59.688 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:17.0.0-11208.gd3799b8c.el8.x86_64 3/133 2022-03-21T13:51:59.885 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:17.0.0-11208.gd3799b8c.el8.x86_64 4/133 2022-03-21T13:52:00.033 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:17.0.0-11208.gd3799b8c.el8.x86_64 4/133 2022-03-21T13:52:00.144 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 22/133 2022-03-21T13:52:00.249 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:17.0.0-11208.gd3799b8c.el8.x86_64 5/133 2022-03-21T13:52:00.334 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:17.0.0-11208.gd3799b8c.el8.x86_64 5/133 2022-03-21T13:52:00.351 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.12-1.el8.x86_64 23/133 2022-03-21T13:52:00.629 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:17.0.0-11208.gd3799b8c.el8.x86_6 6/133 2022-03-21T13:52:00.785 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 7/133 2022-03-21T13:52:00.889 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 7/133 2022-03-21T13:52:01.087 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 23/133 2022-03-21T13:52:01.370 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 24/133 2022-03-21T13:52:01.428 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/133 2022-03-21T13:52:01.588 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/133 2022-03-21T13:52:01.677 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:17.0.0-11208.gd3799b8c.el8.x86_64 9/133 2022-03-21T13:52:01.790 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:17.0.0-11208.gd3799b8c.el8 26/133 2022-03-21T13:52:01.796 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:17.0.0-11208.gd3799b8c.el8.x86_64 9/133 2022-03-21T13:52:01.927 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:17.0.0-11208.gd3799b8c.e 27/133 2022-03-21T13:52:02.064 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/133 2022-03-21T13:52:02.152 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:17.0.0-11208.gd3799b8c.el8.x86_ 28/133 2022-03-21T13:52:02.224 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/133 2022-03-21T13:52:02.350 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 29/133 2022-03-21T13:52:02.385 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:17.0.0-11208.gd3799b8c.el8.x86_6 12/133 2022-03-21T13:52:02.482 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:17.0.0-11208.gd3799b8c.el8.x86_6 12/133 2022-03-21T13:52:02.693 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:17.0.0-11208.gd3799b8c.el8.x8 13/133 2022-03-21T13:52:02.965 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:17.0.0-11208.gd3799b8c.el8.x8 13/133 2022-03-21T13:52:03.218 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 14/133 2022-03-21T13:52:03.269 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 14/133 2022-03-21T13:52:03.528 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 15/133 2022-03-21T13:52:03.777 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-1:1.30.0-13.el8_4.x86_64 15/133 2022-03-21T13:52:04.364 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 29/133 2022-03-21T13:52:04.478 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 15/133 2022-03-21T13:52:04.760 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/133 2022-03-21T13:52:04.992 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/133 2022-03-21T13:52:05.190 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/133 2022-03-21T13:52:05.323 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 19/133 2022-03-21T13:52:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 20/133 2022-03-21T13:52:05.553 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 30/133 2022-03-21T13:52:05.604 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 20/133 2022-03-21T13:52:05.793 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 21/133 2022-03-21T13:52:05.883 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 31/133 2022-03-21T13:52:06.132 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 32/133 2022-03-21T13:52:06.343 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 21/133 2022-03-21T13:52:06.357 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/133 2022-03-21T13:52:06.542 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 22/133 2022-03-21T13:52:06.557 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/133 2022-03-21T13:52:06.736 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/133 2022-03-21T13:52:06.917 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 36/133 2022-03-21T13:52:07.068 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 22/133 2022-03-21T13:52:07.079 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 37/133 2022-03-21T13:52:07.268 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.12-1.el8.x86_64 23/133 2022-03-21T13:52:07.270 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:17.0.0-11208.gd3799b8c.el8.x86_ 38/133 2022-03-21T13:52:07.500 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 39/133 2022-03-21T13:52:07.644 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 40/133 2022-03-21T13:52:07.791 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 41/133 2022-03-21T13:52:07.871 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 41/133 2022-03-21T13:52:07.997 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 23/133 2022-03-21T13:52:08.048 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jq-1.5-12.el8.x86_64 42/133 2022-03-21T13:52:08.207 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 43/133 2022-03-21T13:52:08.313 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 24/133 2022-03-21T13:52:08.421 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 44/133 2022-03-21T13:52:08.604 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.1-7.el8.noarch 45/133 2022-03-21T13:52:08.613 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/133 2022-03-21T13:52:08.762 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 46/133 2022-03-21T13:52:08.858 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:17.0.0-11208.gd3799b8c.el8 26/133 2022-03-21T13:52:08.985 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/133 2022-03-21T13:52:09.018 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:17.0.0-11208.gd3799b8c.e 27/133 2022-03-21T13:52:09.167 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/133 2022-03-21T13:52:09.294 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:17.0.0-11208.gd3799b8c.el8.x86_ 28/133 2022-03-21T13:52:09.412 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 49/133 2022-03-21T13:52:09.767 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 29/133 2022-03-21T13:52:09.872 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 50/133 2022-03-21T13:52:10.152 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 51/133 2022-03-21T13:52:10.378 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 52/133 2022-03-21T13:52:10.607 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 53/133 2022-03-21T13:52:10.848 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 54/133 2022-03-21T13:52:11.211 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 55/133 2022-03-21T13:52:11.424 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 56/133 2022-03-21T13:52:11.600 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 57/133 2022-03-21T13:52:11.791 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 29/133 2022-03-21T13:52:11.842 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 58/133 2022-03-21T13:52:11.998 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.7-12.el8.x86_64 59/133 2022-03-21T13:52:12.165 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 60/133 2022-03-21T13:52:12.318 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 61/133 2022-03-21T13:52:12.477 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 62/133 2022-03-21T13:52:12.744 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 63/133 2022-03-21T13:52:12.862 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 30/133 2022-03-21T13:52:13.031 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/133 2022-03-21T13:52:13.225 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 31/133 2022-03-21T13:52:13.289 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/133 2022-03-21T13:52:13.499 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 32/133 2022-03-21T13:52:13.517 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 66/133 2022-03-21T13:52:13.648 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 67/133 2022-03-21T13:52:13.769 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/133 2022-03-21T13:52:13.820 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/133 2022-03-21T13:52:14.031 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/133 2022-03-21T13:52:14.102 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/133 2022-03-21T13:52:14.195 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/133 2022-03-21T13:52:14.297 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/133 2022-03-21T13:52:14.416 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 36/133 2022-03-21T13:52:14.436 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/133 2022-03-21T13:52:14.576 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/133 2022-03-21T13:52:14.637 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 37/133 2022-03-21T13:52:14.759 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/133 2022-03-21T13:52:14.870 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:17.0.0-11208.gd3799b8c.el8.x86_ 38/133 2022-03-21T13:52:14.920 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/133 2022-03-21T13:52:15.094 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/133 2022-03-21T13:52:15.108 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 39/133 2022-03-21T13:52:15.262 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 40/133 2022-03-21T13:52:15.269 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/133 2022-03-21T13:52:15.421 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/133 2022-03-21T13:52:15.441 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 41/133 2022-03-21T13:52:15.512 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 41/133 2022-03-21T13:52:15.656 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/133 2022-03-21T13:52:15.690 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jq-1.5-12.el8.x86_64 42/133 2022-03-21T13:52:15.832 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 43/133 2022-03-21T13:52:15.860 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/133 2022-03-21T13:52:16.045 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/133 2022-03-21T13:52:16.110 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 44/133 2022-03-21T13:52:16.275 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/133 2022-03-21T13:52:16.321 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.1-7.el8.noarch 45/133 2022-03-21T13:52:16.496 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 46/133 2022-03-21T13:52:16.497 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/133 2022-03-21T13:52:16.638 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/133 2022-03-21T13:52:16.711 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/133 2022-03-21T13:52:16.855 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/133 2022-03-21T13:52:16.932 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/133 2022-03-21T13:52:17.173 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 49/133 2022-03-21T13:52:17.534 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 50/133 2022-03-21T13:52:17.820 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 51/133 2022-03-21T13:52:17.977 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/133 2022-03-21T13:52:18.045 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 52/133 2022-03-21T13:52:18.288 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/133 2022-03-21T13:52:18.317 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 53/133 2022-03-21T13:52:18.507 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/133 2022-03-21T13:52:18.581 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 54/133 2022-03-21T13:52:18.811 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/133 2022-03-21T13:52:18.960 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 55/133 2022-03-21T13:52:19.048 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/133 2022-03-21T13:52:19.199 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 56/133 2022-03-21T13:52:19.222 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/133 2022-03-21T13:52:19.409 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 57/133 2022-03-21T13:52:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/133 2022-03-21T13:52:19.643 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 58/133 2022-03-21T13:52:19.832 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.7-12.el8.x86_64 59/133 2022-03-21T13:52:20.026 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 60/133 2022-03-21T13:52:20.202 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 61/133 2022-03-21T13:52:20.379 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 62/133 2022-03-21T13:52:20.707 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 63/133 2022-03-21T13:52:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/133 2022-03-21T13:52:21.331 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/133 2022-03-21T13:52:21.610 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 66/133 2022-03-21T13:52:21.783 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 67/133 2022-03-21T13:52:22.013 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/133 2022-03-21T13:52:22.321 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/133 2022-03-21T13:52:22.573 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/133 2022-03-21T13:52:22.720 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/133 2022-03-21T13:52:22.894 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/133 2022-03-21T13:52:23.136 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/133 2022-03-21T13:52:23.344 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/133 2022-03-21T13:52:23.556 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/133 2022-03-21T13:52:23.777 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/133 2022-03-21T13:52:23.906 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 92/133 2022-03-21T13:52:23.956 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/133 2022-03-21T13:52:24.080 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 92/133 2022-03-21T13:52:24.214 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/133 2022-03-21T13:52:24.437 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/133 2022-03-21T13:52:24.639 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/133 2022-03-21T13:52:24.785 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 92/133 2022-03-21T13:52:24.909 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/133 2022-03-21T13:52:24.924 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:17.0.0-11208.gd3799b8c.el8.x86_64 93/133 2022-03-21T13:52:25.021 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:17.0.0-11208.gd3799b8c.el8.x86_64 93/133 2022-03-21T13:52:25.174 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/133 2022-03-21T13:52:25.180 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:17.0.0-11208.gd3799b8c.el8.x86_64 94/133 2022-03-21T13:52:25.350 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/133 2022-03-21T13:52:25.640 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/133 2022-03-21T13:52:26.808 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/133 2022-03-21T13:52:27.188 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/133 2022-03-21T13:52:27.450 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/133 2022-03-21T13:52:27.819 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/133 2022-03-21T13:52:28.141 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/133 2022-03-21T13:52:28.389 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/133 2022-03-21T13:52:28.632 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/133 2022-03-21T13:52:33.602 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 92/133 2022-03-21T13:52:33.831 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 92/133 2022-03-21T13:52:34.403 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 92/133 2022-03-21T13:52:34.695 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:17.0.0-11208.gd3799b8c.el8.x86_64 93/133 2022-03-21T13:52:34.778 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:17.0.0-11208.gd3799b8c.el8.x86_64 93/133 2022-03-21T13:52:34.930 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:17.0.0-11208.gd3799b8c.el8.x86_64 94/133 2022-03-21T13:52:43.033 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:17.0.0-11208.gd3799b8c.el8.x86_64 94/133 2022-03-21T13:52:43.033 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2022-03-21T13:52:43.033 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2022-03-21T13:52:43.034 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /dev 2022-03-21T13:52:43.034 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /run 2022-03-21T13:52:43.034 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2022-03-21T13:52:43.034 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2022-03-21T13:52:43.035 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2022-03-21T13:52:43.035 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2022-03-21T13:52:43.035 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /dev 2022-03-21T13:52:43.035 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:52:43.419 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:17.0.0-11208.gd3799b8c.el8.noarch 95/133 2022-03-21T13:52:44.922 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:17.0.0-11208.gd3799b8c.el8.noarch 95/133 2022-03-21T13:52:45.105 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:17.0.0-11208.gd3799b8c.el8.x86_64 96/133 2022-03-21T13:52:45.332 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:17.0.0-11208.gd3799b8c.el8.x86_64 96/133 2022-03-21T13:52:45.468 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:17.0.0-11208.gd3799b8c.el8.x86_64 97/133 2022-03-21T13:52:45.857 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:17.0.0-11208.gd3799b8c.el8.x86_64 97/133 2022-03-21T13:52:45.993 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:17.0.0-11208.gd3799b8c.el8.x86_64 98/133 2022-03-21T13:52:46.012 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:17.0.0-11208.gd3799b8c.el8.x86_64 98/133 2022-03-21T13:52:48.211 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:17.0.0-11208.gd3799b8c.el8.noarch 99/133 2022-03-21T13:52:48.432 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:17.0.0-11208.gd3799b8c.el8.noarch 99/133 2022-03-21T13:52:48.566 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-11208.gd3799b8c. 100/133 2022-03-21T13:52:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-11208.gd3799b8c 101/133 2022-03-21T13:52:48.876 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-11208.gd3799b8c.el8.no 102/133 2022-03-21T13:52:49.082 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-11208.gd3799b8c.el8.no 102/133 2022-03-21T13:52:49.262 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-11208.gd3799b8c.el8. 103/133 2022-03-21T13:52:50.235 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-11208.gd3799b8c.el8. 103/133 2022-03-21T13:52:50.468 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-11208.gd3 104/133 2022-03-21T13:52:50.568 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-11208.gd3 104/133 2022-03-21T13:52:50.924 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-11208.gd3799b8c.e 105/133 2022-03-21T13:52:51.070 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:17.0.0-11208.gd3799b8c.el8.x86_64 106/133 2022-03-21T13:52:51.109 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:17.0.0-11208.gd3799b8c.el8.x86_64 106/133 2022-03-21T13:52:51.283 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:17.0.0-11208.gd3799b8c.el8.noarc 107/133 2022-03-21T13:52:51.295 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-11208.gd3799b8c.el8.noarc 107/133 2022-03-21T13:52:52.314 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:17.0.0-11208.gd3799b8c.el8.x86_64 108/133 2022-03-21T13:52:52.586 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 109/133 2022-03-21T13:52:52.680 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 109/133 2022-03-21T13:52:52.689 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:17.0.0-11208.gd3799b8c.el8.x86_64 94/133 2022-03-21T13:52:52.689 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2022-03-21T13:52:52.689 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2022-03-21T13:52:52.690 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2022-03-21T13:52:52.690 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /run 2022-03-21T13:52:52.690 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2022-03-21T13:52:52.690 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2022-03-21T13:52:52.690 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2022-03-21T13:52:52.691 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2022-03-21T13:52:52.691 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2022-03-21T13:52:52.691 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:52:52.800 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-11208.gd379 110/133 2022-03-21T13:52:52.847 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-11208.gd379 110/133 2022-03-21T13:52:52.984 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_6 111/133 2022-03-21T13:52:53.052 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:17.0.0-11208.gd3799b8c.el8.noarch 95/133 2022-03-21T13:52:53.375 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_6 111/133 2022-03-21T13:52:53.542 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_64 112/133 2022-03-21T13:52:54.553 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:17.0.0-11208.gd3799b8c.el8.noarch 95/133 2022-03-21T13:52:54.767 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:17.0.0-11208.gd3799b8c.el8.x86_64 96/133 2022-03-21T13:52:54.995 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:17.0.0-11208.gd3799b8c.el8.x86_64 96/133 2022-03-21T13:52:55.144 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:17.0.0-11208.gd3799b8c.el8.x86_64 97/133 2022-03-21T13:52:55.536 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:17.0.0-11208.gd3799b8c.el8.x86_64 97/133 2022-03-21T13:52:55.711 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:17.0.0-11208.gd3799b8c.el8.x86_64 98/133 2022-03-21T13:52:55.728 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:17.0.0-11208.gd3799b8c.el8.x86_64 98/133 2022-03-21T13:52:57.905 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_64 112/133 2022-03-21T13:52:57.976 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:17.0.0-11208.gd3799b8c.el8.noarch 99/133 2022-03-21T13:52:58.199 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:17.0.0-11208.gd3799b8c.el8.noarch 99/133 2022-03-21T13:52:58.391 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-11208.gd3799b8c. 100/133 2022-03-21T13:52:58.571 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-11208.gd3799b8c 101/133 2022-03-21T13:52:58.785 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-11208.gd3799b8c.el8.no 102/133 2022-03-21T13:52:58.814 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:17.0.0-11208.gd3799b8c.el8.x86_64 113/133 2022-03-21T13:52:58.988 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-11208.gd3799b8c.el8.no 102/133 2022-03-21T13:52:59.086 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 114/133 2022-03-21T13:52:59.216 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-11208.gd3799b8c.el8. 103/133 2022-03-21T13:52:59.342 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 115/133 2022-03-21T13:52:59.561 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 116/133 2022-03-21T13:52:59.732 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-25.el8.x86_64 117/133 2022-03-21T13:52:59.745 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 117/133 2022-03-21T13:52:59.879 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:17.0.0-11208.gd3799b8c.el8.x86 118/133 2022-03-21T13:53:00.010 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 119/133 2022-03-21T13:53:00.169 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 120/133 2022-03-21T13:53:00.183 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-11208.gd3799b8c.el8. 103/133 2022-03-21T13:53:00.353 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 121/133 2022-03-21T13:53:00.435 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-11208.gd3 104/133 2022-03-21T13:53:00.533 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-top-2:17.0.0-11208.gd3799b8c.el8.noarch 122/133 2022-03-21T13:53:00.535 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-11208.gd3 104/133 2022-03-21T13:53:00.699 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 123/133 2022-03-21T13:53:00.915 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 124/133 2022-03-21T13:53:00.937 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-11208.gd3799b8c.e 105/133 2022-03-21T13:53:01.107 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.0.4-10.el8.x86_64 125/133 2022-03-21T13:53:01.141 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:17.0.0-11208.gd3799b8c.el8.x86_64 106/133 2022-03-21T13:53:01.160 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 125/133 2022-03-21T13:53:01.180 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:17.0.0-11208.gd3799b8c.el8.x86_64 106/133 2022-03-21T13:53:01.340 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.1-9.el8.x86_64 126/133 2022-03-21T13:53:01.342 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:17.0.0-11208.gd3799b8c.el8.noarc 107/133 2022-03-21T13:53:01.351 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 126/133 2022-03-21T13:53:01.354 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-11208.gd3799b8c.el8.noarc 107/133 2022-03-21T13:53:01.484 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 127/133 2022-03-21T13:53:01.600 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-tui-1:1.30.0-7.el8.x86_64 128/133 2022-03-21T13:53:01.601 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 129/133 2022-03-21T13:53:01.801 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 129/133 2022-03-21T13:53:01.917 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-team-1:1.30.0-7.el8.x86_64 130/133 2022-03-21T13:53:01.926 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 131/133 2022-03-21T13:53:01.926 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-1:1.30.0-7.el8.x86_64 131/133 2022-03-21T13:53:02.344 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 131/133 2022-03-21T13:53:02.344 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 132/133 2022-03-21T13:53:02.429 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:17.0.0-11208.gd3799b8c.el8.x86_64 108/133 2022-03-21T13:53:02.594 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-7.el8.x86_64 132/133 2022-03-21T13:53:02.594 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/133 2022-03-21T13:53:02.649 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 109/133 2022-03-21T13:53:02.741 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 109/133 2022-03-21T13:53:02.934 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-11208.gd379 110/133 2022-03-21T13:53:02.981 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-11208.gd379 110/133 2022-03-21T13:53:03.176 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_6 111/133 2022-03-21T13:53:03.441 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/133 2022-03-21T13:53:03.441 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:17.0.0-11208.gd3799b8c.el8.x86_64 1/133 2022-03-21T13:53:03.441 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:17.0.0-11208.gd3799b8c.el8.x86_64 2/133 2022-03-21T13:53:03.441 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 3/133 2022-03-21T13:53:03.442 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 4/133 2022-03-21T13:53:03.442 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-11208.gd379 5/133 2022-03-21T13:53:03.442 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:17.0.0-11208.gd3799b8c.el8.x86_64 6/133 2022-03-21T13:53:03.442 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:17.0.0-11208.gd3799b8c.el8.x86_64 7/133 2022-03-21T13:53:03.443 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:17.0.0-11208.gd3799b8c.el8.x86_64 8/133 2022-03-21T13:53:03.443 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:17.0.0-11208.gd3799b8c.el8.x86_64 9/133 2022-03-21T13:53:03.443 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 10/133 2022-03-21T13:53:03.443 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:17.0.0-11208.gd3799b8c.el8.x86_64 11/133 2022-03-21T13:53:03.443 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:17.0.0-11208.gd3799b8c.el8.x86_64 12/133 2022-03-21T13:53:03.444 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_6 13/133 2022-03-21T13:53:03.444 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:17.0.0-11208.gd3799b8c.el8.x86 14/133 2022-03-21T13:53:03.444 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:17.0.0-11208.gd3799b8c.el8.x86_64 15/133 2022-03-21T13:53:03.444 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:17.0.0-11208.gd3799b8c.el8.x86_6 16/133 2022-03-21T13:53:03.444 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:17.0.0-11208.gd3799b8c.el8.x86_ 17/133 2022-03-21T13:53:03.445 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:17.0.0-11208.gd3799b8c.el8.x8 18/133 2022-03-21T13:53:03.445 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:17.0.0-11208.gd3799b8c.el8.x86_64 19/133 2022-03-21T13:53:03.445 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:17.0.0-11208.gd3799b8c.e 20/133 2022-03-21T13:53:03.445 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:17.0.0-11208.gd3799b8c.el8 21/133 2022-03-21T13:53:03.445 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:17.0.0-11208.gd3799b8c.el8.x86_ 22/133 2022-03-21T13:53:03.446 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:17.0.0-11208.gd3799b8c.el8.x86_6 23/133 2022-03-21T13:53:03.446 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 24/133 2022-03-21T13:53:03.446 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 25/133 2022-03-21T13:53:03.446 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 26/133 2022-03-21T13:53:03.447 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_64 27/133 2022-03-21T13:53:03.447 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 28/133 2022-03-21T13:53:03.447 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-11208.gd3799b8c 29/133 2022-03-21T13:53:03.447 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-11208.gd3799b8c.el8.no 30/133 2022-03-21T13:53:03.447 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-11208.gd3799b8c.el8. 31/133 2022-03-21T13:53:03.448 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-11208.gd3 32/133 2022-03-21T13:53:03.448 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-11208.gd3799b8c.e 33/133 2022-03-21T13:53:03.448 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:17.0.0-11208.gd3799b8c.el8.noarc 34/133 2022-03-21T13:53:03.448 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-11208.gd3799b8c. 35/133 2022-03-21T13:53:03.448 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:17.0.0-11208.gd3799b8c.el8.noarch 36/133 2022-03-21T13:53:03.449 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:17.0.0-11208.gd3799b8c.el8.noarch 37/133 2022-03-21T13:53:03.449 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-top-2:17.0.0-11208.gd3799b8c.el8.noarch 38/133 2022-03-21T13:53:03.449 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/133 2022-03-21T13:53:03.449 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/133 2022-03-21T13:53:03.450 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/133 2022-03-21T13:53:03.450 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/133 2022-03-21T13:53:03.450 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/133 2022-03-21T13:53:03.450 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/133 2022-03-21T13:53:03.450 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/133 2022-03-21T13:53:03.451 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/133 2022-03-21T13:53:03.451 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/133 2022-03-21T13:53:03.451 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/133 2022-03-21T13:53:03.451 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/133 2022-03-21T13:53:03.452 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/133 2022-03-21T13:53:03.452 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/133 2022-03-21T13:53:03.452 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/133 2022-03-21T13:53:03.452 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/133 2022-03-21T13:53:03.452 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/133 2022-03-21T13:53:03.453 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/133 2022-03-21T13:53:03.453 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/133 2022-03-21T13:53:03.453 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/133 2022-03-21T13:53:03.453 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/133 2022-03-21T13:53:03.453 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/133 2022-03-21T13:53:03.454 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/133 2022-03-21T13:53:03.454 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/133 2022-03-21T13:53:03.454 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/133 2022-03-21T13:53:03.454 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/133 2022-03-21T13:53:03.455 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/133 2022-03-21T13:53:03.455 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/133 2022-03-21T13:53:03.455 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/133 2022-03-21T13:53:03.455 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/133 2022-03-21T13:53:03.456 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/133 2022-03-21T13:53:03.456 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/133 2022-03-21T13:53:03.456 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/133 2022-03-21T13:53:03.456 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 71/133 2022-03-21T13:53:03.457 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/133 2022-03-21T13:53:03.457 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/133 2022-03-21T13:53:03.457 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 74/133 2022-03-21T13:53:03.457 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 75/133 2022-03-21T13:53:03.457 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 76/133 2022-03-21T13:53:03.458 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 77/133 2022-03-21T13:53:03.458 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 78/133 2022-03-21T13:53:03.458 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 79/133 2022-03-21T13:53:03.458 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/133 2022-03-21T13:53:03.459 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 81/133 2022-03-21T13:53:03.459 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 82/133 2022-03-21T13:53:03.459 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 83/133 2022-03-21T13:53:03.459 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 84/133 2022-03-21T13:53:03.459 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/133 2022-03-21T13:53:03.460 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 86/133 2022-03-21T13:53:03.460 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 87/133 2022-03-21T13:53:03.460 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/133 2022-03-21T13:53:03.460 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 89/133 2022-03-21T13:53:03.461 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 90/133 2022-03-21T13:53:03.461 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/133 2022-03-21T13:53:03.461 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 92/133 2022-03-21T13:53:03.461 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 93/133 2022-03-21T13:53:03.461 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 94/133 2022-03-21T13:53:03.462 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 95/133 2022-03-21T13:53:03.462 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 96/133 2022-03-21T13:53:03.462 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.1-9.el8.x86_64 97/133 2022-03-21T13:53:03.462 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jq-1.5-12.el8.x86_64 98/133 2022-03-21T13:53:03.462 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 99/133 2022-03-21T13:53:03.463 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 100/133 2022-03-21T13:53:03.463 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 101/133 2022-03-21T13:53:03.463 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.1-7.el8.noarch 102/133 2022-03-21T13:53:03.463 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 103/133 2022-03-21T13:53:03.464 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 104/133 2022-03-21T13:53:03.464 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 105/133 2022-03-21T13:53:03.464 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 106/133 2022-03-21T13:53:03.464 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 107/133 2022-03-21T13:53:03.464 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 108/133 2022-03-21T13:53:03.465 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 109/133 2022-03-21T13:53:03.465 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 110/133 2022-03-21T13:53:03.465 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 111/133 2022-03-21T13:53:03.465 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 112/133 2022-03-21T13:53:03.465 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 113/133 2022-03-21T13:53:03.466 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 114/133 2022-03-21T13:53:03.466 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 115/133 2022-03-21T13:53:03.466 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 116/133 2022-03-21T13:53:03.466 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 117/133 2022-03-21T13:53:03.466 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 118/133 2022-03-21T13:53:03.467 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 119/133 2022-03-21T13:53:03.467 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.0.4-10.el8.x86_64 120/133 2022-03-21T13:53:03.467 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 121/133 2022-03-21T13:53:03.467 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:17.0.0-11208.gd3799b8c.el8.x86_64 122/133 2022-03-21T13:53:03.468 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 123/133 2022-03-21T13:53:03.468 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:17.0.0-11208.gd3799b8c.el8.x86_64 124/133 2022-03-21T13:53:03.468 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 125/133 2022-03-21T13:53:03.468 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 126/133 2022-03-21T13:53:03.468 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.30.0-7.el8.x86_64 127/133 2022-03-21T13:53:03.469 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 128/133 2022-03-21T13:53:03.469 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 129/133 2022-03-21T13:53:03.469 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 130/133 2022-03-21T13:53:03.469 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.30.0-7.el8.x86_64 131/133 2022-03-21T13:53:03.469 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.30.0-13.el8_4.x86_64 132/133 2022-03-21T13:53:03.565 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_6 111/133 2022-03-21T13:53:03.809 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_64 112/133 2022-03-21T13:53:08.163 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_64 112/133 2022-03-21T13:53:09.140 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:17.0.0-11208.gd3799b8c.el8.x86_64 113/133 2022-03-21T13:53:09.445 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 114/133 2022-03-21T13:53:09.768 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 115/133 2022-03-21T13:53:10.028 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 116/133 2022-03-21T13:53:10.174 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-25.el8.x86_64 117/133 2022-03-21T13:53:10.187 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 117/133 2022-03-21T13:53:10.354 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:17.0.0-11208.gd3799b8c.el8.x86 118/133 2022-03-21T13:53:10.536 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 119/133 2022-03-21T13:53:10.703 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 120/133 2022-03-21T13:53:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 121/133 2022-03-21T13:53:11.100 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:17.0.0-11208.gd3799b8c.el8.noarch 122/133 2022-03-21T13:53:11.283 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 123/133 2022-03-21T13:53:11.568 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 124/133 2022-03-21T13:53:11.774 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.0.4-10.el8.x86_64 125/133 2022-03-21T13:53:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 125/133 2022-03-21T13:53:12.032 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.1-9.el8.x86_64 126/133 2022-03-21T13:53:12.043 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 126/133 2022-03-21T13:53:12.176 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 127/133 2022-03-21T13:53:12.343 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-tui-1:1.30.0-7.el8.x86_64 128/133 2022-03-21T13:53:12.343 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 129/133 2022-03-21T13:53:12.577 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 129/133 2022-03-21T13:53:12.718 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-team-1:1.30.0-7.el8.x86_64 130/133 2022-03-21T13:53:12.728 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 131/133 2022-03-21T13:53:12.729 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-1:1.30.0-7.el8.x86_64 131/133 2022-03-21T13:53:13.211 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 131/133 2022-03-21T13:53:13.211 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 132/133 2022-03-21T13:53:13.486 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-7.el8.x86_64 132/133 2022-03-21T13:53:13.487 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/133 2022-03-21T13:53:14.378 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/133 2022-03-21T13:53:14.378 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:17.0.0-11208.gd3799b8c.el8.x86_64 1/133 2022-03-21T13:53:14.379 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:17.0.0-11208.gd3799b8c.el8.x86_64 2/133 2022-03-21T13:53:14.379 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 3/133 2022-03-21T13:53:14.379 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 4/133 2022-03-21T13:53:14.379 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-11208.gd379 5/133 2022-03-21T13:53:14.380 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:17.0.0-11208.gd3799b8c.el8.x86_64 6/133 2022-03-21T13:53:14.380 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:17.0.0-11208.gd3799b8c.el8.x86_64 7/133 2022-03-21T13:53:14.380 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:17.0.0-11208.gd3799b8c.el8.x86_64 8/133 2022-03-21T13:53:14.380 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:17.0.0-11208.gd3799b8c.el8.x86_64 9/133 2022-03-21T13:53:14.381 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 10/133 2022-03-21T13:53:14.381 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:17.0.0-11208.gd3799b8c.el8.x86_64 11/133 2022-03-21T13:53:14.381 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:17.0.0-11208.gd3799b8c.el8.x86_64 12/133 2022-03-21T13:53:14.381 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_6 13/133 2022-03-21T13:53:14.381 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:17.0.0-11208.gd3799b8c.el8.x86 14/133 2022-03-21T13:53:14.382 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:17.0.0-11208.gd3799b8c.el8.x86_64 15/133 2022-03-21T13:53:14.382 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:17.0.0-11208.gd3799b8c.el8.x86_6 16/133 2022-03-21T13:53:14.382 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:17.0.0-11208.gd3799b8c.el8.x86_ 17/133 2022-03-21T13:53:14.382 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:17.0.0-11208.gd3799b8c.el8.x8 18/133 2022-03-21T13:53:14.383 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:17.0.0-11208.gd3799b8c.el8.x86_64 19/133 2022-03-21T13:53:14.383 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:17.0.0-11208.gd3799b8c.e 20/133 2022-03-21T13:53:14.383 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:17.0.0-11208.gd3799b8c.el8 21/133 2022-03-21T13:53:14.383 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:17.0.0-11208.gd3799b8c.el8.x86_ 22/133 2022-03-21T13:53:14.383 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:17.0.0-11208.gd3799b8c.el8.x86_6 23/133 2022-03-21T13:53:14.384 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 24/133 2022-03-21T13:53:14.384 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 25/133 2022-03-21T13:53:14.384 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 26/133 2022-03-21T13:53:14.384 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_64 27/133 2022-03-21T13:53:14.385 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 28/133 2022-03-21T13:53:14.385 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-11208.gd3799b8c 29/133 2022-03-21T13:53:14.385 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-11208.gd3799b8c.el8.no 30/133 2022-03-21T13:53:14.385 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-11208.gd3799b8c.el8. 31/133 2022-03-21T13:53:14.385 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-11208.gd3 32/133 2022-03-21T13:53:14.386 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-11208.gd3799b8c.e 33/133 2022-03-21T13:53:14.386 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:17.0.0-11208.gd3799b8c.el8.noarc 34/133 2022-03-21T13:53:14.386 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-11208.gd3799b8c. 35/133 2022-03-21T13:53:14.386 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:17.0.0-11208.gd3799b8c.el8.noarch 36/133 2022-03-21T13:53:14.387 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:17.0.0-11208.gd3799b8c.el8.noarch 37/133 2022-03-21T13:53:14.387 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:17.0.0-11208.gd3799b8c.el8.noarch 38/133 2022-03-21T13:53:14.387 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/133 2022-03-21T13:53:14.387 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/133 2022-03-21T13:53:14.388 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/133 2022-03-21T13:53:14.388 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/133 2022-03-21T13:53:14.388 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/133 2022-03-21T13:53:14.388 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/133 2022-03-21T13:53:14.388 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/133 2022-03-21T13:53:14.389 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/133 2022-03-21T13:53:14.389 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/133 2022-03-21T13:53:14.389 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/133 2022-03-21T13:53:14.389 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/133 2022-03-21T13:53:14.389 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/133 2022-03-21T13:53:14.390 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/133 2022-03-21T13:53:14.390 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/133 2022-03-21T13:53:14.390 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/133 2022-03-21T13:53:14.390 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/133 2022-03-21T13:53:14.391 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/133 2022-03-21T13:53:14.391 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/133 2022-03-21T13:53:14.391 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/133 2022-03-21T13:53:14.391 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/133 2022-03-21T13:53:14.391 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/133 2022-03-21T13:53:14.392 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/133 2022-03-21T13:53:14.392 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/133 2022-03-21T13:53:14.392 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/133 2022-03-21T13:53:14.392 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/133 2022-03-21T13:53:14.393 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/133 2022-03-21T13:53:14.393 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/133 2022-03-21T13:53:14.393 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/133 2022-03-21T13:53:14.393 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/133 2022-03-21T13:53:14.393 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/133 2022-03-21T13:53:14.394 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/133 2022-03-21T13:53:14.394 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/133 2022-03-21T13:53:14.394 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 71/133 2022-03-21T13:53:14.394 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/133 2022-03-21T13:53:14.395 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/133 2022-03-21T13:53:14.395 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 74/133 2022-03-21T13:53:14.395 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 75/133 2022-03-21T13:53:14.395 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 76/133 2022-03-21T13:53:14.395 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 77/133 2022-03-21T13:53:14.396 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 78/133 2022-03-21T13:53:14.396 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 79/133 2022-03-21T13:53:14.396 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/133 2022-03-21T13:53:14.396 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 81/133 2022-03-21T13:53:14.397 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 82/133 2022-03-21T13:53:14.397 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 83/133 2022-03-21T13:53:14.397 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 84/133 2022-03-21T13:53:14.397 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/133 2022-03-21T13:53:14.397 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 86/133 2022-03-21T13:53:14.398 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 87/133 2022-03-21T13:53:14.398 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/133 2022-03-21T13:53:14.398 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 89/133 2022-03-21T13:53:14.398 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 90/133 2022-03-21T13:53:14.399 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/133 2022-03-21T13:53:14.399 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 92/133 2022-03-21T13:53:14.399 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 93/133 2022-03-21T13:53:14.400 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 94/133 2022-03-21T13:53:14.400 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 95/133 2022-03-21T13:53:14.400 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 96/133 2022-03-21T13:53:14.400 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.1-9.el8.x86_64 97/133 2022-03-21T13:53:14.400 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jq-1.5-12.el8.x86_64 98/133 2022-03-21T13:53:14.401 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 99/133 2022-03-21T13:53:14.401 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 100/133 2022-03-21T13:53:14.401 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 101/133 2022-03-21T13:53:14.401 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.1-7.el8.noarch 102/133 2022-03-21T13:53:14.402 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 103/133 2022-03-21T13:53:14.402 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 104/133 2022-03-21T13:53:14.402 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 105/133 2022-03-21T13:53:14.402 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 106/133 2022-03-21T13:53:14.402 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 107/133 2022-03-21T13:53:14.403 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 108/133 2022-03-21T13:53:14.403 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 109/133 2022-03-21T13:53:14.403 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 110/133 2022-03-21T13:53:14.403 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 111/133 2022-03-21T13:53:14.404 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 112/133 2022-03-21T13:53:14.404 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 113/133 2022-03-21T13:53:14.404 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 114/133 2022-03-21T13:53:14.404 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 115/133 2022-03-21T13:53:14.404 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 116/133 2022-03-21T13:53:14.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 117/133 2022-03-21T13:53:14.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 118/133 2022-03-21T13:53:14.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 119/133 2022-03-21T13:53:14.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.0.4-10.el8.x86_64 120/133 2022-03-21T13:53:14.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 121/133 2022-03-21T13:53:14.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:17.0.0-11208.gd3799b8c.el8.x86_64 122/133 2022-03-21T13:53:14.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 123/133 2022-03-21T13:53:14.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:17.0.0-11208.gd3799b8c.el8.x86_64 124/133 2022-03-21T13:53:14.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 125/133 2022-03-21T13:53:14.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 126/133 2022-03-21T13:53:14.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.30.0-7.el8.x86_64 127/133 2022-03-21T13:53:14.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 128/133 2022-03-21T13:53:14.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 129/133 2022-03-21T13:53:14.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 130/133 2022-03-21T13:53:14.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.30.0-7.el8.x86_64 131/133 2022-03-21T13:53:14.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.30.0-13.el8_4.x86_64 132/133 2022-03-21T13:53:19.001 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.30.0-7.el8.x86_64 133/133 2022-03-21T13:53:19.002 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:00:07 ago on Mon 21 Mar 2022 01:53:12 PM UTC. 2022-03-21T13:53:22.699 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2022-03-21T13:53:22.820 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:22.820 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2022-03-21T13:53:22.821 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-1:1.30.0-13.el8_4.x86_64 2022-03-21T13:53:22.821 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 2022-03-21T13:53:22.821 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team-1:1.30.0-13.el8_4.x86_64 2022-03-21T13:53:22.821 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 2022-03-21T13:53:22.821 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.822 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.822 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2022-03-21T13:53:22.822 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.1-7.el8.noarch 2022-03-21T13:53:22.822 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.0.4-10.el8.x86_64 2022-03-21T13:53:22.823 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.823 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.823 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.823 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.824 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:22.824 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.824 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.824 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.824 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:22.825 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:22.825 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:22.825 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:22.825 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:22.826 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.827 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.827 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:22.827 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.827 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.828 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.828 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:22.828 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:22.828 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.828 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:22.829 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2022-03-21T13:53:22.829 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.1-9.el8.x86_64 2022-03-21T13:53:22.829 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.7-12.el8.x86_64 2022-03-21T13:53:22.829 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-03-21T13:53:22.830 INFO:teuthology.orchestra.run.smithi171.stdout: jq-1.5-12.el8.x86_64 2022-03-21T13:53:22.830 INFO:teuthology.orchestra.run.smithi171.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2022-03-21T13:53:22.830 INFO:teuthology.orchestra.run.smithi171.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2022-03-21T13:53:22.830 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-03-21T13:53:22.830 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.831 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.831 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.831 INFO:teuthology.orchestra.run.smithi171.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2022-03-21T13:53:22.831 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-8.4.1-1.el8.x86_64 2022-03-21T13:53:22.832 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.2-3.el8.x86_64 2022-03-21T13:53:22.832 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-8.4.1-1.el8.x86_64 2022-03-21T13:53:22.832 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-03-21T13:53:22.832 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.832 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.833 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-03-21T13:53:22.833 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.833 INFO:teuthology.orchestra.run.smithi171.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-03-21T13:53:22.833 INFO:teuthology.orchestra.run.smithi171.stdout: libsepol-devel-2.9-2.el8.x86_64 2022-03-21T13:53:22.833 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-25.el8.x86_64 2022-03-21T13:53:22.834 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.3.1-3.el8.x86_64 2022-03-21T13:53:22.834 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2022-03-21T13:53:22.834 INFO:teuthology.orchestra.run.smithi171.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-03-21T13:53:22.834 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-03-21T13:53:22.835 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-03-21T13:53:22.835 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.12-1.el8.x86_64 2022-03-21T13:53:22.835 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-03-21T13:53:22.835 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2022-03-21T13:53:22.836 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-03-21T13:53:22.836 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-03-21T13:53:22.836 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-03-21T13:53:22.836 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-03-21T13:53:22.837 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.5.1-5.el8.noarch 2022-03-21T13:53:22.837 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-03-21T13:53:22.837 INFO:teuthology.orchestra.run.smithi171.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-03-21T13:53:22.837 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-03-21T13:53:22.837 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.838 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.838 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.838 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-03-21T13:53:22.838 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-03-21T13:53:22.839 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-03-21T13:53:22.839 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-03-21T13:53:22.839 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2022-03-21T13:53:22.839 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-03-21T13:53:22.840 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-6.2-6.el8.noarch 2022-03-21T13:53:22.840 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-03-21T13:53:22.840 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2022-03-21T13:53:22.840 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-03-21T13:53:22.840 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-03-21T13:53:22.841 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-03-21T13:53:22.841 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-03-21T13:53:22.841 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-03-21T13:53:22.841 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.0.6-13.el8.noarch 2022-03-21T13:53:22.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-03-21T13:53:22.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-03-21T13:53:22.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-03-21T13:53:22.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2022-03-21T13:53:22.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2022-03-21T13:53:22.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-03-21T13:53:22.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-03-21T13:53:22.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-2.6-1.el8.noarch 2022-03-21T13:53:22.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-03-21T13:53:22.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-03-21T13:53:22.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-03-21T13:53:22.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-03-21T13:53:22.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.14-14.el8.noarch 2022-03-21T13:53:22.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2017.2-9.el8.noarch 2022-03-21T13:53:22.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-03-21T13:53:22.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-03-21T13:53:22.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.4.1-12.el8.noarch 2022-03-21T13:53:22.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.8-1.el8.noarch 2022-03-21T13:53:22.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2022-03-21T13:53:22.847 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-03-21T13:53:22.847 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-03-21T13:53:22.847 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-03-21T13:53:22.847 INFO:teuthology.orchestra.run.smithi171.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-03-21T13:53:22.848 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-03-21T13:53:22.848 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-03-21T13:53:22.848 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-03-21T13:53:22.848 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-03-21T13:53:22.848 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-03-21T13:53:22.849 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-03-21T13:53:22.849 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.849 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.849 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:22.850 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.3.3-2.el8.x86_64 2022-03-21T13:53:22.850 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2022-03-21T13:53:22.850 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-03-21T13:53:22.851 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-03-21T13:53:22.851 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:22.851 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2022-03-21T13:53:23.000 DEBUG:teuthology.parallel:result is None 2022-03-21T13:53:30.070 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.30.0-7.el8.x86_64 133/133 2022-03-21T13:53:30.071 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:07 ago on Mon 21 Mar 2022 01:53:23 PM UTC. 2022-03-21T13:53:34.512 INFO:teuthology.orchestra.run.smithi160.stdout:Installed products updated. 2022-03-21T13:53:34.632 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:34.633 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2022-03-21T13:53:34.633 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-1:1.30.0-13.el8_4.x86_64 2022-03-21T13:53:34.633 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 2022-03-21T13:53:34.633 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team-1:1.30.0-13.el8_4.x86_64 2022-03-21T13:53:34.634 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 2022-03-21T13:53:34.634 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.634 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.634 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2022-03-21T13:53:34.635 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.1-7.el8.noarch 2022-03-21T13:53:34.635 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.0.4-10.el8.x86_64 2022-03-21T13:53:34.635 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.635 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.635 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.636 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.636 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:34.636 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.636 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.637 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.637 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:34.637 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:34.637 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:34.637 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:34.638 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:34.638 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.638 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.638 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:34.638 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:34.639 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:34.640 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.640 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:17.0.0-11208.gd3799b8c.el8.noarch 2022-03-21T13:53:34.640 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2022-03-21T13:53:34.640 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.1-9.el8.x86_64 2022-03-21T13:53:34.640 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.7-12.el8.x86_64 2022-03-21T13:53:34.641 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-03-21T13:53:34.641 INFO:teuthology.orchestra.run.smithi160.stdout: jq-1.5-12.el8.x86_64 2022-03-21T13:53:34.641 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2022-03-21T13:53:34.641 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2022-03-21T13:53:34.641 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-03-21T13:53:34.642 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.642 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.642 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.642 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2022-03-21T13:53:34.643 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-8.4.1-1.el8.x86_64 2022-03-21T13:53:34.643 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.2-3.el8.x86_64 2022-03-21T13:53:34.643 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-8.4.1-1.el8.x86_64 2022-03-21T13:53:34.643 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-03-21T13:53:34.643 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.644 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.644 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-03-21T13:53:34.644 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.644 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-03-21T13:53:34.645 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel-2.9-2.el8.x86_64 2022-03-21T13:53:34.645 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-25.el8.x86_64 2022-03-21T13:53:34.645 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.3.1-3.el8.x86_64 2022-03-21T13:53:34.645 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2022-03-21T13:53:34.646 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-03-21T13:53:34.646 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-03-21T13:53:34.646 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-03-21T13:53:34.646 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.12-1.el8.x86_64 2022-03-21T13:53:34.647 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-03-21T13:53:34.647 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2022-03-21T13:53:34.647 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-03-21T13:53:34.647 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-03-21T13:53:34.647 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-03-21T13:53:34.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-03-21T13:53:34.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.5.1-5.el8.noarch 2022-03-21T13:53:34.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-03-21T13:53:34.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-03-21T13:53:34.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-03-21T13:53:34.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-03-21T13:53:34.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-03-21T13:53:34.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-03-21T13:53:34.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-03-21T13:53:34.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2022-03-21T13:53:34.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-03-21T13:53:34.651 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-6.2-6.el8.noarch 2022-03-21T13:53:34.651 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-03-21T13:53:34.651 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2022-03-21T13:53:34.651 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-03-21T13:53:34.652 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-03-21T13:53:34.652 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-03-21T13:53:34.652 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-03-21T13:53:34.652 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-03-21T13:53:34.652 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.0.6-13.el8.noarch 2022-03-21T13:53:34.653 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-03-21T13:53:34.653 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-03-21T13:53:34.653 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-03-21T13:53:34.653 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2022-03-21T13:53:34.653 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2022-03-21T13:53:34.654 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-03-21T13:53:34.654 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-03-21T13:53:34.654 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-2.6-1.el8.noarch 2022-03-21T13:53:34.654 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-03-21T13:53:34.654 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-03-21T13:53:34.655 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-03-21T13:53:34.655 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-03-21T13:53:34.655 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.14-14.el8.noarch 2022-03-21T13:53:34.655 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2017.2-9.el8.noarch 2022-03-21T13:53:34.656 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.656 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.656 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-03-21T13:53:34.656 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-03-21T13:53:34.656 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.657 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.4.1-12.el8.noarch 2022-03-21T13:53:34.657 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.8-1.el8.noarch 2022-03-21T13:53:34.657 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2022-03-21T13:53:34.657 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-03-21T13:53:34.658 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-03-21T13:53:34.658 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-03-21T13:53:34.658 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-03-21T13:53:34.658 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-03-21T13:53:34.658 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-03-21T13:53:34.659 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-03-21T13:53:34.659 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-03-21T13:53:34.659 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-03-21T13:53:34.659 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-03-21T13:53:34.659 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.660 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.660 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:17.0.0-11208.gd3799b8c.el8.x86_64 2022-03-21T13:53:34.660 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.3.3-2.el8.x86_64 2022-03-21T13:53:34.660 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2022-03-21T13:53:34.661 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-03-21T13:53:34.661 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-03-21T13:53:34.661 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:34.662 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2022-03-21T13:53:34.773 DEBUG:teuthology.parallel:result is None 2022-03-21T13:53:34.774 DEBUG:teuthology.orchestra.run.smithi160:> sudo lsb_release -is 2022-03-21T13:53:34.824 INFO:teuthology.orchestra.run.smithi160.stdout:RedHatEnterprise 2022-03-21T13:53:34.825 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-03-21T13:53:34.826 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d3799b8cfa5046465710eadeea2bed7bb4681409 2022-03-21T13:53:34.981 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-03-21T13:53:34.999 INFO:teuthology.orchestra.run.smithi160.stdout:17.0.0-11208.gd3799b8c.el8 2022-03-21T13:53:35.000 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-11208.gd3799b8c.el8 2022-03-21T13:53:35.001 INFO:teuthology.task.install:The correct ceph version 17.0.0-11208.gd3799b8c is installed. 2022-03-21T13:53:35.001 DEBUG:teuthology.orchestra.run.smithi171:> sudo lsb_release -is 2022-03-21T13:53:35.059 INFO:teuthology.orchestra.run.smithi171.stdout:RedHatEnterprise 2022-03-21T13:53:35.061 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-03-21T13:53:35.061 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d3799b8cfa5046465710eadeea2bed7bb4681409 2022-03-21T13:53:35.211 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-03-21T13:53:35.234 INFO:teuthology.orchestra.run.smithi171.stdout:17.0.0-11208.gd3799b8c.el8 2022-03-21T13:53:35.234 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-11208.gd3799b8c.el8 2022-03-21T13:53:35.235 INFO:teuthology.task.install:The correct ceph version 17.0.0-11208.gd3799b8c is installed. 2022-03-21T13:53:35.235 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-03-21T13:53:35.236 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:53:35.236 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-03-21T13:53:35.260 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:53:35.260 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-03-21T13:53:35.302 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-03-21T13:53:35.303 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:53:35.303 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2022-03-21T13:53:35.327 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-03-21T13:53:35.392 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:53:35.392 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2022-03-21T13:53:35.419 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-03-21T13:53:35.486 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-03-21T13:53:35.486 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:53:35.487 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2022-03-21T13:53:35.511 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-03-21T13:53:35.574 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:53:35.575 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2022-03-21T13:53:35.603 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-03-21T13:53:35.670 INFO:teuthology.run_tasks:Running task ceph... 2022-03-21T13:53:35.729 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-03-21T13:53:35.730 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /var/log/ceph 2022-03-21T13:53:35.733 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2022-03-21T13:53:35.759 INFO:tasks.ceph:Disabling ceph logrotate... 2022-03-21T13:53:35.760 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/logrotate.d/ceph 2022-03-21T13:53:35.796 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2022-03-21T13:53:35.825 INFO:tasks.ceph:Creating extra log directories... 2022-03-21T13:53:35.825 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-03-21T13:53:35.859 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-03-21T13:53:35.897 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-03-21T13:53:35.897 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-03-21T13:53:35.898 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-03-21T13:53:35.898 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:53:35.898 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-03-21T13:53:35.935 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-03-21T13:53:36.042 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-03-21T13:53:36.065 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:53:36.066 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-03-21T13:53:36.081 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-03-21T13:53:36.189 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-03-21T13:53:36.219 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-03-21T13:53:36.219 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-03-21T13:53:36.219 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749908', 'branch': 'wip-vshankar-testing-20220319-163539', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '6749908', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8c5f4f463f1899102a5e979f88c37daab5f66d1e'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20220319-163539'}, 'ceph': {'cephfs': {'max_mds': 5, 'mds_dir_prefetch': True, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'd3799b8cfa5046465710eadeea2bed7bb4681409'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd3799b8cfa5046465710eadeea2bed7bb4681409'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20220319-163539', 'sha1': 'd3799b8cfa5046465710eadeea2bed7bb4681409'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 75, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': 'd3799b8cfa5046465710eadeea2bed7bb4681409', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20220319-163539', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d3799b8cfa5046465710eadeea2bed7bb4681409/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd3799b8cfa5046465710eadeea2bed7bb4681409', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi160.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC988s3kt/75zAAEUEL+eeU9mmYpwqRSDg0QqnZKrzpg+vgMIxKXpwB5rO4YbbDbASzQ+aTHXZCKik0OeRYQgYprKpEh0hgiGcitV31qBKrvjNpU6Q4uHM6MWUdNeaaxL8FnOnihKguaFLUQQtUR3YZ6LWlPwNO+DovP0159oXHMP/hzTcExEpyo49C5Xcxj1MNFwnkcq4sM5ZaUwm4APDEFVEv6HVuuMHwxpHKT7MM16GkhVkklosERyHMNuDwCPBnPuE0y0t2RLCLrEVESlcWdOFAqM2+cplA0o777eQatau0OHGmQ680NqQrscuIBqik4cG3UFV3vMe4tR/Bye/PUpJWV+xyjlvklUuc2NSMs8hQBCWQwolaQrqI19s5Ba0J5IcUEWYePqKjqSTm/gM/2YqLNrGeO5gAle7yRod8uMHLAd3zo4641r+B49hxqLakFTI0Rqd+OE+pOfRcaSfZ5JWKFkE1bjYsNFxQWn5w7SlmMswa6FP7hfttG84Ivf8=', 'smithi171.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxJU09wnLkWVg2DloFgQ2GG793CtVaxa/W35bTelRDP+PX1d6+FJrRbsq/Nbp7gHitgteoN8BrNdcdTx2AORypnig/gejWhb+0tUvrLu8OvFniyz2jJd2OtenzAeMehorqFqXTiZKHKip0/waj0YXi0rj7TSm4wyh/xVSVUqC91OgV59o+/UI6yku09p9zxMo/IAJdGNPFD5zpZ0P9YH9677m8ZpcIMJME7uPZJcHZsfn/unKgWeacTD33wof+Fe1rCa6LVM82UC7VMkIDVRQoQvAOn2ZK+lyaMUaZNNysTok6mrAvmGvZ9/x+rWdiR5YmT2u4Y9hCRC3iBQlSk2zTcJbuHgX3jHwhLMj616kh2MDalhy3A7zs9xksfvqHyFDZDH31UduA0pIVeRHLAsfIW5ks5SH4WqMLiLA5lPNiMzEzK5ybxhUJ8ntKAhPk2jNVXTIBXYxi7quPzqCzI5vMcz/FBK2CSYZ9m5Bn/mRnLi0OhkVeGSKAdhQWz71tQ7E='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8c5f4f463f1899102a5e979f88c37daab5f66d1e'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'd3799b8cfa5046465710eadeea2bed7bb4681409'}}, {'ceph': None}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'a4e18662e5de936eb0ac089e531b933ecbcadb0a', 'timestamp': '2022-03-21_06:07:09', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.22301'} 2022-03-21T13:53:36.220 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-03-21T13:53:36.223 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-03-21T13:53:36.269 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/run/ceph 2022-03-21T13:53:36.278 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2022-03-21T13:53:36.336 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:53:36.336 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2022-03-21T13:53:36.356 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-03-21T13:53:36.356 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-03-21T13:53:36.410 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-03-21T13:53:36.411 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-21T13:53:36.411 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 59135 Links: 1 2022-03-21T13:53:36.411 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-21T13:53:36.411 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2022-03-21T13:53:36.411 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2022-03-21 13:53:13.990081211 +0000 2022-03-21T13:53:36.412 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2022-03-21 13:50:45.865943782 +0000 2022-03-21T13:53:36.412 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2022-03-21 13:50:45.865943782 +0000 2022-03-21T13:53:36.412 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2022-03-21T13:53:36.421 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2022-03-21T13:53:36.421 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2022-03-21T13:53:36.421 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000249596 s, 2.1 MB/s 2022-03-21T13:53:36.423 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-03-21T13:53:36.477 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-03-21T13:53:36.478 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-21T13:53:36.478 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 61708 Links: 1 2022-03-21T13:53:36.478 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-21T13:53:36.478 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2022-03-21T13:53:36.479 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2022-03-21 13:53:13.990081211 +0000 2022-03-21T13:53:36.479 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2022-03-21 13:50:46.191938872 +0000 2022-03-21T13:53:36.479 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2022-03-21 13:50:46.191938872 +0000 2022-03-21T13:53:36.479 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2022-03-21T13:53:36.487 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2022-03-21T13:53:36.487 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2022-03-21T13:53:36.488 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000215741 s, 2.4 MB/s 2022-03-21T13:53:36.490 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-03-21T13:53:36.543 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-03-21T13:53:36.543 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-21T13:53:36.543 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 64634 Links: 1 2022-03-21T13:53:36.544 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-21T13:53:36.544 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2022-03-21T13:53:36.544 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2022-03-21 13:53:13.990081211 +0000 2022-03-21T13:53:36.544 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2022-03-21 13:50:46.516933977 +0000 2022-03-21T13:53:36.544 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2022-03-21 13:50:46.516933977 +0000 2022-03-21T13:53:36.545 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2022-03-21T13:53:36.552 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2022-03-21T13:53:36.552 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2022-03-21T13:53:36.553 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000201738 s, 2.5 MB/s 2022-03-21T13:53:36.555 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-03-21T13:53:36.609 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-03-21T13:53:36.609 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-21T13:53:36.609 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 64057 Links: 1 2022-03-21T13:53:36.610 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-21T13:53:36.610 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2022-03-21T13:53:36.610 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2022-03-21 13:53:13.990081211 +0000 2022-03-21T13:53:36.610 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2022-03-21 13:50:46.859928810 +0000 2022-03-21T13:53:36.610 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2022-03-21 13:50:46.859928810 +0000 2022-03-21T13:53:36.611 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2022-03-21T13:53:36.618 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2022-03-21T13:53:36.619 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2022-03-21T13:53:36.619 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000190388 s, 2.7 MB/s 2022-03-21T13:53:36.621 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-03-21T13:53:36.621 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:53:36.622 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2022-03-21T13:53:36.637 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-03-21T13:53:36.637 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-03-21T13:53:36.692 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-03-21T13:53:36.692 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-21T13:53:36.692 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 60713 Links: 1 2022-03-21T13:53:36.692 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-21T13:53:36.693 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2022-03-21T13:53:36.693 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2022-03-21 13:53:03.037597089 +0000 2022-03-21T13:53:36.693 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2022-03-21 13:50:50.914950548 +0000 2022-03-21T13:53:36.693 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2022-03-21 13:50:50.914950548 +0000 2022-03-21T13:53:36.693 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2022-03-21T13:53:36.701 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2022-03-21T13:53:36.702 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2022-03-21T13:53:36.702 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000252571 s, 2.0 MB/s 2022-03-21T13:53:36.705 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-03-21T13:53:36.760 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-03-21T13:53:36.760 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-21T13:53:36.760 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 64550 Links: 1 2022-03-21T13:53:36.760 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-21T13:53:36.761 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2022-03-21T13:53:36.761 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2022-03-21 13:53:03.037597089 +0000 2022-03-21T13:53:36.761 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2022-03-21 13:50:51.255943942 +0000 2022-03-21T13:53:36.761 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2022-03-21 13:50:51.255943942 +0000 2022-03-21T13:53:36.761 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2022-03-21T13:53:36.769 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2022-03-21T13:53:36.769 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2022-03-21T13:53:36.770 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000202053 s, 2.5 MB/s 2022-03-21T13:53:36.772 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-03-21T13:53:36.826 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-03-21T13:53:36.827 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-21T13:53:36.827 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 64607 Links: 1 2022-03-21T13:53:36.827 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-21T13:53:36.827 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2022-03-21T13:53:36.828 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2022-03-21 13:53:03.037597089 +0000 2022-03-21T13:53:36.828 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2022-03-21 13:50:51.597937317 +0000 2022-03-21T13:53:36.828 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2022-03-21 13:50:51.597937317 +0000 2022-03-21T13:53:36.828 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2022-03-21T13:53:36.836 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2022-03-21T13:53:36.836 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2022-03-21T13:53:36.836 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000226241 s, 2.3 MB/s 2022-03-21T13:53:36.839 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-03-21T13:53:36.893 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-03-21T13:53:36.894 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-21T13:53:36.894 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 54094 Links: 1 2022-03-21T13:53:36.894 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-21T13:53:36.894 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2022-03-21T13:53:36.894 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2022-03-21 13:53:03.037597089 +0000 2022-03-21T13:53:36.895 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2022-03-21 13:50:51.956930362 +0000 2022-03-21T13:53:36.895 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2022-03-21 13:50:51.956930362 +0000 2022-03-21T13:53:36.895 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2022-03-21T13:53:36.903 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2022-03-21T13:53:36.903 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2022-03-21T13:53:36.903 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000191432 s, 2.7 MB/s 2022-03-21T13:53:36.906 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-03-21T13:53:36.906 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-03-21T13:53:36.906 INFO:tasks.ceph:Generating config... 2022-03-21T13:53:36.908 INFO:tasks.ceph:[client] client mount timeout = 600 2022-03-21T13:53:36.908 INFO:tasks.ceph:[client] debug client = 20 2022-03-21T13:53:36.908 INFO:tasks.ceph:[client] debug ms = 1 2022-03-21T13:53:36.909 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-03-21T13:53:36.909 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-03-21T13:53:36.909 INFO:tasks.ceph:[global] ms die on skipped message = False 2022-03-21T13:53:36.909 INFO:tasks.ceph:[mds] debug mds = 20 2022-03-21T13:53:36.910 INFO:tasks.ceph:[mds] debug ms = 1 2022-03-21T13:53:36.910 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2022-03-21T13:53:36.910 INFO:tasks.ceph:[mds] mds bal merge size = 5 2022-03-21T13:53:36.910 INFO:tasks.ceph:[mds] mds bal split bits = 3 2022-03-21T13:53:36.911 INFO:tasks.ceph:[mds] mds bal split size = 100 2022-03-21T13:53:36.911 INFO:tasks.ceph:[mds] mds debug frag = True 2022-03-21T13:53:36.911 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-03-21T13:53:36.912 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = False 2022-03-21T13:53:36.912 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-03-21T13:53:36.912 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-03-21T13:53:36.912 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2022-03-21T13:53:36.913 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-03-21T13:53:36.913 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-03-21T13:53:36.913 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-03-21T13:53:36.913 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-03-21T13:53:36.914 INFO:tasks.ceph:[mgr] debug ms = 1 2022-03-21T13:53:36.914 INFO:tasks.ceph:[mon] debug mon = 20 2022-03-21T13:53:36.914 INFO:tasks.ceph:[mon] debug ms = 1 2022-03-21T13:53:36.915 INFO:tasks.ceph:[mon] debug paxos = 20 2022-03-21T13:53:36.915 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-03-21T13:53:36.915 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-03-21T13:53:36.915 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2022-03-21T13:53:36.916 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-03-21T13:53:36.916 INFO:tasks.ceph:[osd] debug bluefs = 20 2022-03-21T13:53:36.916 INFO:tasks.ceph:[osd] debug bluestore = 20 2022-03-21T13:53:36.917 INFO:tasks.ceph:[osd] debug ms = 1 2022-03-21T13:53:36.917 INFO:tasks.ceph:[osd] debug osd = 20 2022-03-21T13:53:36.917 INFO:tasks.ceph:[osd] debug rocksdb = 10 2022-03-21T13:53:36.917 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-03-21T13:53:36.918 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-03-21T13:53:36.918 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-03-21T13:53:36.918 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-03-21T13:53:36.919 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2022-03-21T13:53:36.919 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-03-21T13:53:36.919 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-03-21T13:53:36.919 INFO:tasks.ceph:Setting up mon.a... 2022-03-21T13:53:36.920 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-03-21T13:53:36.974 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.keyring 2022-03-21T13:53:36.977 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-03-21T13:53:37.016 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-03-21T13:53:37.079 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.160'), ('mon.b', '172.21.15.171'), ('mon.c', '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]')] 2022-03-21T13:53:37.080 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.160,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-03-21T13:53:37.081 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:53:37.082 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-03-21T13:53:37.134 DEBUG:teuthology.orchestra.run.smithi160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.160 --add b 172.21.15.171 --addv c '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:53:37.214 INFO:teuthology.orchestra.run.smithi160.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:53:37.215 INFO:teuthology.orchestra.run.smithi160.stdout:monmaptool: generated fsid b2a3ddc8-064e-4cc9-8187-33ea19afd50a 2022-03-21T13:53:37.215 INFO:teuthology.orchestra.run.smithi160.stdout:setting min_mon_release = octopus 2022-03-21T13:53:37.215 INFO:teuthology.orchestra.run.smithi160.stdout:epoch 0 2022-03-21T13:53:37.215 INFO:teuthology.orchestra.run.smithi160.stdout:fsid b2a3ddc8-064e-4cc9-8187-33ea19afd50a 2022-03-21T13:53:37.216 INFO:teuthology.orchestra.run.smithi160.stdout:last_changed 2022-03-21T13:53:37.214862+0000 2022-03-21T13:53:37.216 INFO:teuthology.orchestra.run.smithi160.stdout:created 2022-03-21T13:53:37.214862+0000 2022-03-21T13:53:37.216 INFO:teuthology.orchestra.run.smithi160.stdout:min_mon_release 15 (octopus) 2022-03-21T13:53:37.216 INFO:teuthology.orchestra.run.smithi160.stdout:election_strategy: 1 2022-03-21T13:53:37.217 INFO:teuthology.orchestra.run.smithi160.stdout:0: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.a 2022-03-21T13:53:37.217 INFO:teuthology.orchestra.run.smithi160.stdout:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2022-03-21T13:53:37.217 INFO:teuthology.orchestra.run.smithi160.stdout:2: [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] mon.c 2022-03-21T13:53:37.217 INFO:teuthology.orchestra.run.smithi160.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-03-21T13:53:37.218 DEBUG:teuthology.orchestra.run.smithi160:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-03-21T13:53:37.272 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b2a3ddc8-064e-4cc9-8187-33ea19afd50a... 2022-03-21T13:53:37.273 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-03-21T13:53:37.315 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-03-21T13:53:37.354 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2022-03-21T13:53:37.354 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2022-03-21T13:53:37.355 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-03-21T13:53:37.355 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2022-03-21T13:53:37.355 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.355 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2022-03-21T13:53:37.356 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.356 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2022-03-21T13:53:37.356 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.356 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2022-03-21T13:53:37.356 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2022-03-21T13:53:37.357 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.357 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2022-03-21T13:53:37.357 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2022-03-21T13:53:37.357 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.357 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2022-03-21T13:53:37.358 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2022-03-21T13:53:37.358 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.358 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2022-03-21T13:53:37.358 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2022-03-21T13:53:37.358 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.359 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2022-03-21T13:53:37.359 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.359 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2022-03-21T13:53:37.359 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2022-03-21T13:53:37.359 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2022-03-21T13:53:37.360 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2022-03-21T13:53:37.360 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2022-03-21T13:53:37.360 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2022-03-21T13:53:37.360 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2022-03-21T13:53:37.360 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-03-21T13:53:37.361 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2022-03-21T13:53:37.361 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2022-03-21T13:53:37.361 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.361 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-03-21T13:53:37.361 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.362 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2022-03-21T13:53:37.362 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.362 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2022-03-21T13:53:37.362 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.363 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2022-03-21T13:53:37.363 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2022-03-21T13:53:37.363 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2022-03-21T13:53:37.363 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.160,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2022-03-21T13:53:37.363 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on skipped message = False 2022-03-21T13:53:37.364 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = b2a3ddc8-064e-4cc9-8187-33ea19afd50a 2022-03-21T13:53:37.364 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.364 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2022-03-21T13:53:37.364 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2022-03-21T13:53:37.364 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.365 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2022-03-21T13:53:37.365 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 600 2022-03-21T13:53:37.365 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.365 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2022-03-21T13:53:37.365 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2022-03-21T13:53:37.366 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.366 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2022-03-21T13:53:37.366 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2022-03-21T13:53:37.366 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2022-03-21T13:53:37.366 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.367 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2022-03-21T13:53:37.367 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2022-03-21T13:53:37.367 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.367 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2022-03-21T13:53:37.368 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.368 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2022-03-21T13:53:37.368 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.368 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2022-03-21T13:53:37.368 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.369 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2022-03-21T13:53:37.369 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2022-03-21T13:53:37.369 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.369 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2022-03-21T13:53:37.369 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2022-03-21T13:53:37.369 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore block size = 96636764160 2022-03-21T13:53:37.370 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore compression mode = aggressive 2022-03-21T13:53:37.370 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore fsck on mount = True 2022-03-21T13:53:37.370 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluefs = 20 2022-03-21T13:53:37.370 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluestore = 20 2022-03-21T13:53:37.371 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2022-03-21T13:53:37.371 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 20 2022-03-21T13:53:37.371 INFO:teuthology.orchestra.run.smithi160.stdout: debug rocksdb = 10 2022-03-21T13:53:37.371 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd backfillfull_ratio = 0.85 2022-03-21T13:53:37.371 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd full ratio = 0.9 2022-03-21T13:53:37.372 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd nearfull ratio = 0.8 2022-03-21T13:53:37.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd failsafe full ratio = 0.95 2022-03-21T13:53:37.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd max markdown count = 1000 2022-03-21T13:53:37.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = bluestore 2022-03-21T13:53:37.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2022-03-21T13:53:37.373 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.373 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2022-03-21T13:53:37.373 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2022-03-21T13:53:37.373 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2022-03-21T13:53:37.373 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2022-03-21T13:53:37.374 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2022-03-21T13:53:37.374 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2022-03-21T13:53:37.374 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2022-03-21T13:53:37.374 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2022-03-21T13:53:37.374 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.375 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2022-03-21T13:53:37.375 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2022-03-21T13:53:37.375 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2022-03-21T13:53:37.375 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2022-03-21T13:53:37.375 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2022-03-21T13:53:37.375 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2022-03-21T13:53:37.376 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2022-03-21T13:53:37.376 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2022-03-21T13:53:37.376 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2022-03-21T13:53:37.376 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2022-03-21T13:53:37.377 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2022-03-21T13:53:37.377 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.377 INFO:teuthology.orchestra.run.smithi160.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-03-21T13:53:37.377 INFO:teuthology.orchestra.run.smithi160.stdout: auth mon ticket ttl = 660 # 11m 2022-03-21T13:53:37.377 INFO:teuthology.orchestra.run.smithi160.stdout: auth service ticket ttl = 240 # 4m 2022-03-21T13:53:37.378 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.378 INFO:teuthology.orchestra.run.smithi160.stdout: # don't complain about insecure global_id in the test suite 2022-03-21T13:53:37.378 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-03-21T13:53:37.378 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-03-21T13:53:37.378 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: # 1m isn't quite enough 2022-03-21T13:53:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: mon_down_mkfs_grace = 2m 2022-03-21T13:53:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_filestore_osds = false 2022-03-21T13:53:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: mon op complaint time = 120 2022-03-21T13:53:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:53:37.380 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2022-03-21T13:53:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2022-03-21T13:53:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = true 2022-03-21T13:53:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2022-03-21T13:53:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-03-21T13:53:37.381 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-03-21T13:53:37.381 INFO:teuthology.orchestra.run.smithi160.stdout: client mount timeout = 600 2022-03-21T13:53:37.381 INFO:teuthology.orchestra.run.smithi160.stdout: debug client = 20 2022-03-21T13:53:37.381 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2022-03-21T13:53:37.381 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2022-03-21T13:53:37.382 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2022-03-21T13:53:37.382 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2022-03-21T13:53:37.382 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2022-03-21T13:53:37.382 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2022-03-21T13:53:37.383 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2022-03-21T13:53:37.383 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2022-03-21T13:53:37.383 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.e] 2022-03-21T13:53:37.383 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2022-03-21T13:53:37.383 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2022-03-21T13:53:37.383 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.f] 2022-03-21T13:53:37.384 INFO:teuthology.orchestra.run.smithi160.stdout:[mds] 2022-03-21T13:53:37.384 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds = 20 2022-03-21T13:53:37.384 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2022-03-21T13:53:37.384 INFO:teuthology.orchestra.run.smithi160.stdout: mds bal fragment size max = 10000 2022-03-21T13:53:37.384 INFO:teuthology.orchestra.run.smithi160.stdout: mds bal merge size = 5 2022-03-21T13:53:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: mds bal split bits = 3 2022-03-21T13:53:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: mds bal split size = 100 2022-03-21T13:53:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug frag = True 2022-03-21T13:53:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug scatterstat = True 2022-03-21T13:53:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: mds oft prefetch dirfrags = False 2022-03-21T13:53:37.386 INFO:teuthology.orchestra.run.smithi160.stdout: mds op complaint time = 180 2022-03-21T13:53:37.386 INFO:teuthology.orchestra.run.smithi160.stdout: mds verify scatter = True 2022-03-21T13:53:37.386 INFO:teuthology.orchestra.run.smithi160.stdout: mds_sleep_rank_change = 5000000.0 2022-03-21T13:53:37.386 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2022-03-21T13:53:37.387 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2022-03-21T13:53:37.387 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2022-03-21T13:53:37.388 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2022-03-21T13:53:37.388 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2022-03-21T13:53:37.389 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-03-21T13:53:37.389 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2022-03-21T13:53:37.389 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.389 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2022-03-21T13:53:37.389 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.390 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2022-03-21T13:53:37.390 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.390 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2022-03-21T13:53:37.390 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2022-03-21T13:53:37.391 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.391 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2022-03-21T13:53:37.391 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2022-03-21T13:53:37.391 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.391 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2022-03-21T13:53:37.392 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2022-03-21T13:53:37.392 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.392 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2022-03-21T13:53:37.392 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2022-03-21T13:53:37.392 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.393 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2022-03-21T13:53:37.393 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.393 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2022-03-21T13:53:37.393 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2022-03-21T13:53:37.393 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2022-03-21T13:53:37.394 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2022-03-21T13:53:37.394 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2022-03-21T13:53:37.394 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2022-03-21T13:53:37.394 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2022-03-21T13:53:37.394 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-03-21T13:53:37.395 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2022-03-21T13:53:37.395 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2022-03-21T13:53:37.395 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.395 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-03-21T13:53:37.395 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.396 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2022-03-21T13:53:37.396 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.396 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2022-03-21T13:53:37.396 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.396 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2022-03-21T13:53:37.397 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2022-03-21T13:53:37.397 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2022-03-21T13:53:37.397 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.160,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2022-03-21T13:53:37.397 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on skipped message = False 2022-03-21T13:53:37.397 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = b2a3ddc8-064e-4cc9-8187-33ea19afd50a 2022-03-21T13:53:37.398 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.398 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2022-03-21T13:53:37.398 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2022-03-21T13:53:37.398 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.398 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2022-03-21T13:53:37.399 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2022-03-21T13:53:37.399 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.399 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2022-03-21T13:53:37.399 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2022-03-21T13:53:37.399 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.400 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2022-03-21T13:53:37.400 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2022-03-21T13:53:37.400 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2022-03-21T13:53:37.400 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.400 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2022-03-21T13:53:37.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2022-03-21T13:53:37.401 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2022-03-21T13:53:37.401 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2022-03-21T13:53:37.402 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.402 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2022-03-21T13:53:37.402 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.402 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2022-03-21T13:53:37.402 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2022-03-21T13:53:37.403 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.403 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2022-03-21T13:53:37.403 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2022-03-21T13:53:37.403 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2022-03-21T13:53:37.403 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore compression mode = aggressive 2022-03-21T13:53:37.404 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2022-03-21T13:53:37.404 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 20 2022-03-21T13:53:37.404 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 20 2022-03-21T13:53:37.404 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2022-03-21T13:53:37.404 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2022-03-21T13:53:37.405 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 10 2022-03-21T13:53:37.405 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2022-03-21T13:53:37.405 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2022-03-21T13:53:37.405 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2022-03-21T13:53:37.405 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2022-03-21T13:53:37.406 INFO:teuthology.orchestra.run.smithi171.stdout: osd max markdown count = 1000 2022-03-21T13:53:37.406 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2022-03-21T13:53:37.406 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2022-03-21T13:53:37.406 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.406 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2022-03-21T13:53:37.407 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2022-03-21T13:53:37.407 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2022-03-21T13:53:37.407 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2022-03-21T13:53:37.407 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2022-03-21T13:53:37.408 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2022-03-21T13:53:37.408 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2022-03-21T13:53:37.408 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2022-03-21T13:53:37.408 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.408 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2022-03-21T13:53:37.409 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2022-03-21T13:53:37.409 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2022-03-21T13:53:37.409 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2022-03-21T13:53:37.409 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2022-03-21T13:53:37.409 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2022-03-21T13:53:37.410 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2022-03-21T13:53:37.410 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2022-03-21T13:53:37.410 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2022-03-21T13:53:37.410 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2022-03-21T13:53:37.410 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2022-03-21T13:53:37.411 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.411 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-03-21T13:53:37.411 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2022-03-21T13:53:37.411 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2022-03-21T13:53:37.411 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.412 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2022-03-21T13:53:37.412 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-03-21T13:53:37.412 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-03-21T13:53:37.412 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.412 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2022-03-21T13:53:37.413 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2022-03-21T13:53:37.413 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.413 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2022-03-21T13:53:37.413 INFO:teuthology.orchestra.run.smithi171.stdout: mon op complaint time = 120 2022-03-21T13:53:37.413 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-03-21T13:53:37.414 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2022-03-21T13:53:37.414 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2022-03-21T13:53:37.414 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2022-03-21T13:53:37.414 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2022-03-21T13:53:37.414 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-03-21T13:53:37.415 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-03-21T13:53:37.415 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 600 2022-03-21T13:53:37.415 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2022-03-21T13:53:37.415 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2022-03-21T13:53:37.415 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2022-03-21T13:53:37.416 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2022-03-21T13:53:37.416 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2022-03-21T13:53:37.416 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2022-03-21T13:53:37.416 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2022-03-21T13:53:37.417 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2022-03-21T13:53:37.417 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2022-03-21T13:53:37.417 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.e] 2022-03-21T13:53:37.417 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2022-03-21T13:53:37.417 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2022-03-21T13:53:37.418 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.f] 2022-03-21T13:53:37.418 INFO:teuthology.orchestra.run.smithi171.stdout:[mds] 2022-03-21T13:53:37.418 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds = 20 2022-03-21T13:53:37.418 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2022-03-21T13:53:37.418 INFO:teuthology.orchestra.run.smithi171.stdout: mds bal fragment size max = 10000 2022-03-21T13:53:37.419 INFO:teuthology.orchestra.run.smithi171.stdout: mds bal merge size = 5 2022-03-21T13:53:37.419 INFO:teuthology.orchestra.run.smithi171.stdout: mds bal split bits = 3 2022-03-21T13:53:37.419 INFO:teuthology.orchestra.run.smithi171.stdout: mds bal split size = 100 2022-03-21T13:53:37.419 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug frag = True 2022-03-21T13:53:37.419 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug scatterstat = True 2022-03-21T13:53:37.420 INFO:teuthology.orchestra.run.smithi171.stdout: mds oft prefetch dirfrags = False 2022-03-21T13:53:37.420 INFO:teuthology.orchestra.run.smithi171.stdout: mds op complaint time = 180 2022-03-21T13:53:37.420 INFO:teuthology.orchestra.run.smithi171.stdout: mds verify scatter = True 2022-03-21T13:53:37.420 INFO:teuthology.orchestra.run.smithi171.stdout: mds_sleep_rank_change = 5000000.0 2022-03-21T13:53:37.420 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2022-03-21T13:53:37.421 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2022-03-21T13:53:37.421 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2022-03-21T13:53:37.421 INFO:tasks.ceph:Creating admin key on mon.a... 2022-03-21T13:53:37.421 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-03-21T13:53:37.477 INFO:tasks.ceph:Copying monmap to all nodes... 2022-03-21T13:53:37.477 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:53:37.478 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-03-21T13:53:37.492 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:53:37.493 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-03-21T13:53:37.546 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi160.front.sepia.ceph.com 2022-03-21T13:53:37.546 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:53:37.547 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.keyring 2022-03-21T13:53:37.547 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-03-21T13:53:37.619 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:53:37.619 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:53:37.673 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2022-03-21T13:53:37.674 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:53:37.674 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2022-03-21T13:53:37.674 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-03-21T13:53:37.712 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:53:37.713 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:53:37.768 INFO:tasks.ceph:Setting up mon nodes... 2022-03-21T13:53:37.768 INFO:tasks.ceph:Setting up mgr nodes... 2022-03-21T13:53:37.768 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-03-21T13:53:37.815 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-03-21T13:53:37.817 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-03-21T13:53:37.939 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-03-21T13:53:37.942 INFO:tasks.ceph:Setting up mds nodes... 2022-03-21T13:53:37.942 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-03-21T13:53:37.989 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-03-21T13:53:37.991 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-03-21T13:53:38.015 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-03-21T13:53:38.101 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-03-21T13:53:38.104 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-03-21T13:53:38.129 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2022-03-21T13:53:38.215 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2022-03-21T13:53:38.218 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2022-03-21T13:53:38.241 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-03-21T13:53:38.292 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-03-21T13:53:38.295 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-03-21T13:53:38.320 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-03-21T13:53:38.409 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-03-21T13:53:38.411 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-03-21T13:53:38.435 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2022-03-21T13:53:38.521 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2022-03-21T13:53:38.523 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2022-03-21T13:53:38.547 INFO:tasks.ceph_client:Setting up client nodes... 2022-03-21T13:53:38.547 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-03-21T13:53:38.584 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-03-21T13:53:38.597 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-03-21T13:53:38.597 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-03-21T13:53:38.598 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-03-21T13:53:38.662 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-03-21T13:53:38.663 INFO:tasks.ceph:role: osd.0 2022-03-21T13:53:38.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com 2022-03-21T13:53:38.663 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-03-21T13:53:38.733 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-03-21T13:53:38.733 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-21T13:53:38.734 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-21T13:53:38.734 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 2022-03-21T13:53:38.734 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-21T13:53:38.734 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2022-03-21T13:53:38.735 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-21T13:53:38.735 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-21T13:53:38.735 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-21T13:53:38.735 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-21T13:53:39.096 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2022-03-21T13:53:39.098 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2022-03-21T13:53:39.098 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-03-21T13:53:39.230 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-03-21T13:53:39.261 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-03-21T13:53:39.325 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-03-21T13:53:39.326 INFO:tasks.ceph:role: osd.1 2022-03-21T13:53:39.326 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com 2022-03-21T13:53:39.327 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-03-21T13:53:39.396 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-03-21T13:53:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-21T13:53:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-21T13:53:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 2022-03-21T13:53:39.397 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-21T13:53:39.398 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2022-03-21T13:53:39.398 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-21T13:53:39.398 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-21T13:53:39.398 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-21T13:53:39.398 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-21T13:53:39.753 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2022-03-21T13:53:39.755 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2022-03-21T13:53:39.756 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-03-21T13:53:39.846 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-03-21T13:53:39.875 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-03-21T13:53:39.939 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-03-21T13:53:39.940 INFO:tasks.ceph:role: osd.2 2022-03-21T13:53:39.940 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com 2022-03-21T13:53:39.940 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-03-21T13:53:40.010 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-03-21T13:53:40.011 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-21T13:53:40.011 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-21T13:53:40.011 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 2022-03-21T13:53:40.011 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-21T13:53:40.012 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2022-03-21T13:53:40.012 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-21T13:53:40.012 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-21T13:53:40.012 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-21T13:53:40.012 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-21T13:53:40.383 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2022-03-21T13:53:40.385 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2022-03-21T13:53:40.385 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-03-21T13:53:40.474 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-03-21T13:53:40.503 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-03-21T13:53:40.568 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-03-21T13:53:40.568 INFO:tasks.ceph:role: osd.3 2022-03-21T13:53:40.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com 2022-03-21T13:53:40.569 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-03-21T13:53:40.639 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-03-21T13:53:40.640 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-21T13:53:40.640 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-21T13:53:40.640 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 2022-03-21T13:53:40.641 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-21T13:53:40.641 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2022-03-21T13:53:40.641 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-21T13:53:40.641 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-21T13:53:40.641 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-21T13:53:40.642 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-21T13:53:41.015 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2022-03-21T13:53:41.017 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2022-03-21T13:53:41.018 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-03-21T13:53:41.124 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-03-21T13:53:41.156 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:53:41.239 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:41.238+0000 7f1df92d53c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-03-21T13:53:41.242 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:41.241+0000 7f1df92d53c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-03-21T13:53:41.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:41.241+0000 7f1df92d53c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-03-21T13:53:41.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:41.241+0000 7f1df92d53c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-03-21T13:53:41.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:41.241+0000 7f1df92d53c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-03-21T13:53:41.249 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:41.248+0000 7f1df92d53c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-03-21T13:53:44.108 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-03-21T13:53:44.177 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:53:44.262 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:44.260+0000 7f0626d223c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-03-21T13:53:44.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:44.260+0000 7f0626d223c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-03-21T13:53:44.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:44.260+0000 7f0626d223c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-03-21T13:53:44.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:44.260+0000 7f0626d223c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-03-21T13:53:44.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:44.260+0000 7f0626d223c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-03-21T13:53:44.264 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:44.261+0000 7f0626d223c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-03-21T13:53:47.119 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-03-21T13:53:47.147 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:53:47.233 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:47.231+0000 7f08d3ec23c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-03-21T13:53:47.233 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:47.232+0000 7f08d3ec23c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-03-21T13:53:47.233 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:47.232+0000 7f08d3ec23c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-03-21T13:53:47.233 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:47.232+0000 7f08d3ec23c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-03-21T13:53:47.234 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:47.232+0000 7f08d3ec23c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-03-21T13:53:47.234 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:47.232+0000 7f08d3ec23c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-03-21T13:53:50.107 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-03-21T13:53:50.177 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:53:50.262 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:50.261+0000 7fa4b178f3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-03-21T13:53:50.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:50.261+0000 7fa4b178f3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-03-21T13:53:50.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:50.261+0000 7fa4b178f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-03-21T13:53:50.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:50.261+0000 7fa4b178f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-03-21T13:53:50.264 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:50.261+0000 7fa4b178f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-03-21T13:53:50.264 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:53:50.262+0000 7fa4b178f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-03-21T13:53:53.119 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-03-21T13:53:53.148 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-03-21T13:53:53.179 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-03-21T13:53:53.180 INFO:tasks.ceph:role: osd.4 2022-03-21T13:53:53.180 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2022-03-21T13:53:53.180 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-03-21T13:53:53.256 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-03-21T13:53:53.256 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-21T13:53:53.256 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-21T13:53:53.256 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 2022-03-21T13:53:53.257 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-21T13:53:53.257 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2022-03-21T13:53:53.257 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-21T13:53:53.257 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-21T13:53:53.258 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-21T13:53:53.258 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-21T13:53:53.620 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2022-03-21T13:53:53.621 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2022-03-21T13:53:53.622 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-03-21T13:53:53.762 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-03-21T13:53:53.795 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-03-21T13:53:53.863 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-03-21T13:53:53.863 INFO:tasks.ceph:role: osd.5 2022-03-21T13:53:53.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2022-03-21T13:53:53.864 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-03-21T13:53:53.937 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-03-21T13:53:53.937 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-21T13:53:53.938 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-21T13:53:53.938 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 2022-03-21T13:53:53.938 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-21T13:53:53.938 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2022-03-21T13:53:53.939 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-21T13:53:53.939 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-21T13:53:53.939 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-21T13:53:53.939 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-21T13:53:54.294 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2022-03-21T13:53:54.296 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2022-03-21T13:53:54.297 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-03-21T13:53:54.387 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-03-21T13:53:54.418 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-03-21T13:53:54.484 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-03-21T13:53:54.485 INFO:tasks.ceph:role: osd.6 2022-03-21T13:53:54.485 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2022-03-21T13:53:54.485 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-03-21T13:53:54.557 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-03-21T13:53:54.557 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-21T13:53:54.557 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-21T13:53:54.557 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 2022-03-21T13:53:54.558 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-21T13:53:54.558 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2022-03-21T13:53:54.558 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-21T13:53:54.558 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-21T13:53:54.559 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-21T13:53:54.559 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-21T13:53:54.925 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2022-03-21T13:53:54.927 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2022-03-21T13:53:54.927 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-03-21T13:53:55.025 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-03-21T13:53:55.054 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-03-21T13:53:55.119 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-03-21T13:53:55.120 INFO:tasks.ceph:role: osd.7 2022-03-21T13:53:55.120 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com 2022-03-21T13:53:55.120 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-03-21T13:53:55.191 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-03-21T13:53:55.191 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-21T13:53:55.191 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-21T13:53:55.191 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 2022-03-21T13:53:55.192 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-21T13:53:55.192 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2022-03-21T13:53:55.192 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-21T13:53:55.192 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-21T13:53:55.193 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-21T13:53:55.193 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-21T13:53:55.561 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2022-03-21T13:53:55.562 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2022-03-21T13:53:55.563 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-03-21T13:53:55.651 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-03-21T13:53:55.681 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:53:55.763 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:55.761+0000 7ff87ce1d3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-03-21T13:53:55.767 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:55.765+0000 7ff87ce1d3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-03-21T13:53:55.767 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:55.765+0000 7ff87ce1d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-03-21T13:53:55.767 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:55.765+0000 7ff87ce1d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-03-21T13:53:55.768 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:55.765+0000 7ff87ce1d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-03-21T13:53:55.772 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:55.770+0000 7ff87ce1d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-03-21T13:53:58.622 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-03-21T13:53:58.690 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:53:58.776 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:58.774+0000 7f0cb91a33c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-03-21T13:53:58.777 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:58.774+0000 7f0cb91a33c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-03-21T13:53:58.777 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:58.774+0000 7f0cb91a33c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-03-21T13:53:58.777 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:58.774+0000 7f0cb91a33c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-03-21T13:53:58.777 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:58.774+0000 7f0cb91a33c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-03-21T13:53:58.778 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:53:58.775+0000 7f0cb91a33c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-03-21T13:54:01.636 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-03-21T13:54:01.665 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:54:01.751 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:01.750+0000 7f51481883c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-03-21T13:54:01.751 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:01.750+0000 7f51481883c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-03-21T13:54:01.751 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:01.750+0000 7f51481883c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-03-21T13:54:01.752 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:01.750+0000 7f51481883c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-03-21T13:54:01.752 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:01.750+0000 7f51481883c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-03-21T13:54:01.752 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:01.750+0000 7f51481883c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-03-21T13:54:04.605 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-03-21T13:54:04.630 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:54:04.711 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:04.710+0000 7fda9af553c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-03-21T13:54:04.711 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:04.710+0000 7fda9af553c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-03-21T13:54:04.712 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:04.710+0000 7fda9af553c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-03-21T13:54:04.712 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:04.710+0000 7fda9af553c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-03-21T13:54:04.712 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:04.710+0000 7fda9af553c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-03-21T13:54:04.712 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:04.711+0000 7fda9af553c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-03-21T13:54:06.221 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:54:06.224 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:54:07.569 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-03-21T13:54:07.598 INFO:tasks.ceph:Reading keys from all nodes... 2022-03-21T13:54:07.598 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:07.598 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-03-21T13:54:07.627 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:07.627 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-03-21T13:54:07.694 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:07.694 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-03-21T13:54:07.760 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:07.760 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2022-03-21T13:54:07.825 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:07.826 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-03-21T13:54:07.890 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:07.890 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-03-21T13:54:07.955 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:07.955 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-03-21T13:54:08.018 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:08.018 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-03-21T13:54:08.082 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:08.082 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-03-21T13:54:08.113 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:08.114 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-03-21T13:54:08.181 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:08.181 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-03-21T13:54:08.248 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:08.248 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2022-03-21T13:54:08.314 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:08.315 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-03-21T13:54:08.379 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:08.380 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-03-21T13:54:08.444 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:08.444 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-03-21T13:54:08.508 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:08.509 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-03-21T13:54:08.572 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:08.572 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-03-21T13:54:08.587 INFO:tasks.ceph:Adding keys to all mons... 2022-03-21T13:54:08.588 DEBUG:teuthology.orchestra.run.smithi160:> sudo tee -a /etc/ceph/ceph.keyring 2022-03-21T13:54:08.629 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2022-03-21T13:54:08.651 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.y] 2022-03-21T13:54:08.651 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBhgzhifyCeMBAA4GOth9+E3in6vABH+8V4tw== 2022-03-21T13:54:08.651 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2022-03-21T13:54:08.652 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBhgzhi3TIAOxAApLJNzX77m+3MQ+YT4P0QEg== 2022-03-21T13:54:08.652 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2022-03-21T13:54:08.652 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBigzhirJ4VBhAAIPBRrRhGOPDy7PFPy9YCmQ== 2022-03-21T13:54:08.652 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.e] 2022-03-21T13:54:08.652 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBigzhietPhDBAAFLWHn2ZthEQZfI8QgWJfiw== 2022-03-21T13:54:08.653 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.0] 2022-03-21T13:54:08.653 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBlgzhi30tPDhAAKeotpSXlFa/qL3vJL7IDhA== 2022-03-21T13:54:08.653 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.1] 2022-03-21T13:54:08.653 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBogzhiL9ydDxAAKPhgyPVhW5+dFwAuOCP/pg== 2022-03-21T13:54:08.654 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.2] 2022-03-21T13:54:08.654 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBrgzhix/PaDRAA7iS20xrHhaSmnQ/NdBopJQ== 2022-03-21T13:54:08.654 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.3] 2022-03-21T13:54:08.654 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBugzhivyeeDxAAVb0yoTAu4v63uI12Bs05yQ== 2022-03-21T13:54:08.655 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.x] 2022-03-21T13:54:08.655 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBhgzhikyAFOBAAFuwvZxtfwo05yU8PtDBTtQ== 2022-03-21T13:54:08.655 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2022-03-21T13:54:08.655 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBigzhiI7Z2ERAAfTKqEKUroj8cFp/zO+I2EQ== 2022-03-21T13:54:08.656 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2022-03-21T13:54:08.656 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBigzhiGflkGBAA38DVZcPzmogCXh5q0bFhjg== 2022-03-21T13:54:08.656 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.f] 2022-03-21T13:54:08.656 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBigzhiYzoYHxAA8SGmoMQTCVRqpd9aJg4tPA== 2022-03-21T13:54:08.657 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.4] 2022-03-21T13:54:08.657 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBzgzhi7UR5LRAAbFmsDtGFjrancmtJMdWCQA== 2022-03-21T13:54:08.657 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.5] 2022-03-21T13:54:08.657 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQB2gzhigmpELhAAYHnoIKd5BaW3aNNaDbUapA== 2022-03-21T13:54:08.658 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.6] 2022-03-21T13:54:08.658 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQB5gzhiuP28LBAAAOLDNMNm8OAWoAt5X6nt8w== 2022-03-21T13:54:08.658 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.7] 2022-03-21T13:54:08.658 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQB8gzhiTMphKhAAUhjcsqe9q3AK3wGrAv48Mg== 2022-03-21T13:54:08.658 INFO:teuthology.orchestra.run.smithi160.stdout:[client.0] 2022-03-21T13:54:08.659 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBigzhicSTgIhAAHKhqf/YMINY7p+MCfE9yRw== 2022-03-21T13:54:08.660 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y] 2022-03-21T13:54:08.660 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBhgzhifyCeMBAA4GOth9+E3in6vABH+8V4tw== 2022-03-21T13:54:08.661 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2022-03-21T13:54:08.661 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBhgzhi3TIAOxAApLJNzX77m+3MQ+YT4P0QEg== 2022-03-21T13:54:08.661 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2022-03-21T13:54:08.661 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBigzhirJ4VBhAAIPBRrRhGOPDy7PFPy9YCmQ== 2022-03-21T13:54:08.662 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.e] 2022-03-21T13:54:08.662 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBigzhietPhDBAAFLWHn2ZthEQZfI8QgWJfiw== 2022-03-21T13:54:08.662 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2022-03-21T13:54:08.662 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBlgzhi30tPDhAAKeotpSXlFa/qL3vJL7IDhA== 2022-03-21T13:54:08.662 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2022-03-21T13:54:08.663 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBogzhiL9ydDxAAKPhgyPVhW5+dFwAuOCP/pg== 2022-03-21T13:54:08.663 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2022-03-21T13:54:08.663 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBrgzhix/PaDRAA7iS20xrHhaSmnQ/NdBopJQ== 2022-03-21T13:54:08.663 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2022-03-21T13:54:08.663 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBugzhivyeeDxAAVb0yoTAu4v63uI12Bs05yQ== 2022-03-21T13:54:08.664 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2022-03-21T13:54:08.664 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBhgzhikyAFOBAAFuwvZxtfwo05yU8PtDBTtQ== 2022-03-21T13:54:08.664 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2022-03-21T13:54:08.665 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBigzhiI7Z2ERAAfTKqEKUroj8cFp/zO+I2EQ== 2022-03-21T13:54:08.665 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2022-03-21T13:54:08.665 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBigzhiGflkGBAA38DVZcPzmogCXh5q0bFhjg== 2022-03-21T13:54:08.665 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.f] 2022-03-21T13:54:08.666 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBigzhiYzoYHxAA8SGmoMQTCVRqpd9aJg4tPA== 2022-03-21T13:54:08.666 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2022-03-21T13:54:08.666 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBzgzhi7UR5LRAAbFmsDtGFjrancmtJMdWCQA== 2022-03-21T13:54:08.667 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2022-03-21T13:54:08.667 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB2gzhigmpELhAAYHnoIKd5BaW3aNNaDbUapA== 2022-03-21T13:54:08.667 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.6] 2022-03-21T13:54:08.667 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB5gzhiuP28LBAAAOLDNMNm8OAWoAt5X6nt8w== 2022-03-21T13:54:08.667 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.7] 2022-03-21T13:54:08.667 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB8gzhiTMphKhAAUhjcsqe9q3AK3wGrAv48Mg== 2022-03-21T13:54:08.668 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2022-03-21T13:54:08.668 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBigzhicSTgIhAAHKhqf/YMINY7p+MCfE9yRw== 2022-03-21T13:54:08.668 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-03-21T13:54:08.703 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-03-21T13:54:08.748 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:08.751 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:08.800 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:08.802 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:08.851 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:08.854 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:08.903 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:08.906 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:08.952 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:08.954 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.000 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.003 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.048 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.051 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.097 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-03-21T13:54:09.100 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-03-21T13:54:09.146 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:09.148 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:09.197 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:09.200 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:09.249 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:09.251 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-21T13:54:09.301 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.303 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.350 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.353 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.399 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.402 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.449 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.451 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-21T13:54:09.498 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-03-21T13:54:09.500 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-03-21T13:54:09.550 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-03-21T13:54:09.550 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-03-21T13:54:09.574 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-03-21T13:54:09.665 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-03-21T13:54:09.690 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-03-21T13:54:09.715 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-03-21T13:54:09.804 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-03-21T13:54:09.828 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-03-21T13:54:09.892 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-03-21T13:54:09.985 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-03-21T13:54:10.009 DEBUG:teuthology.orchestra.run.smithi160:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:54:10.012 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-03-21T13:54:10.063 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-03-21T13:54:10.064 INFO:tasks.ceph.mon.a:Restarting daemon 2022-03-21T13:54:10.065 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-03-21T13:54:10.067 INFO:tasks.ceph.mon.a:Started 2022-03-21T13:54:10.067 INFO:tasks.ceph.mon.b:Restarting daemon 2022-03-21T13:54:10.068 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-03-21T13:54:10.105 INFO:tasks.ceph.mon.b:Started 2022-03-21T13:54:10.106 INFO:tasks.ceph.mon.c:Restarting daemon 2022-03-21T13:54:10.106 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-03-21T13:54:10.108 INFO:tasks.ceph.mon.c:Started 2022-03-21T13:54:10.108 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-03-21T13:54:10.109 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-03-21T13:54:10.109 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-03-21T13:54:10.111 INFO:tasks.ceph.mgr.y:Started 2022-03-21T13:54:10.112 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-03-21T13:54:10.112 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-03-21T13:54:10.114 INFO:tasks.ceph.mgr.x:Started 2022-03-21T13:54:10.115 INFO:tasks.ceph:Setting crush tunables to default 2022-03-21T13:54:10.115 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd crush tunables default 2022-03-21T13:54:10.230 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.229+0000 7fd384b9a700 1 Processor -- start 2022-03-21T13:54:10.231 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.229+0000 7fd384b9a700 1 -- start start 2022-03-21T13:54:10.232 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.230+0000 7fd384b9a700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd38006d480 0x7fd3800c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:10.232 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.230+0000 7fd384b9a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd380067cb0 con 0x7fd38006c070 2022-03-21T13:54:10.232 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.230+0000 7fd384b9a700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd380066dc0 con 0x7fd3800c3c50 2022-03-21T13:54:10.233 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.230+0000 7fd384b9a700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3800670a0 con 0x7fd38006d480 2022-03-21T13:54:10.233 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.231+0000 7fd37ed9d700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fd38006c070 0x7fd38015f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:58776/0 (socket says 172.21.15.160:58776) 2022-03-21T13:54:10.233 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.231+0000 7fd37ed9d700 1 -- 172.21.15.160:0/263824585 learned_addr learned my addr 172.21.15.160:0/263824585 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:10.233 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.231+0000 7fd37e59c700 1 --2- 172.21.15.160:0/263824585 >> v2:172.21.15.171:3300/0 conn(0x7fd38006d480 0x7fd3800c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:10.234 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.231+0000 7fd37e59c700 1 -- 172.21.15.160:0/263824585 >> v2:172.21.15.171:3300/0 conn(0x7fd38006d480 msgr2=0x7fd3800c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-03-21T13:54:10.234 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.231+0000 7fd37e59c700 1 -- 172.21.15.160:0/263824585 >> v2:172.21.15.171:3300/0 conn(0x7fd38006d480 msgr2=0x7fd3800c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-03-21T13:54:10.234 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.231+0000 7fd37e59c700 1 --2- 172.21.15.160:0/263824585 >> v2:172.21.15.171:3300/0 conn(0x7fd38006d480 0x7fd3800c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-03-21T13:54:10.234 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.231+0000 7fd37e59c700 1 --2- 172.21.15.160:0/263824585 >> v2:172.21.15.171:3300/0 conn(0x7fd38006d480 0x7fd3800c3710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-03-21T13:54:10.404 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.403+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731698121 0 0) 0x7fd380067cb0 con 0x7fd38006c070 2022-03-21T13:54:10.405 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.403+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3600033f0 con 0x7fd38006c070 2022-03-21T13:54:10.409 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2221156884 0 0) 0x7fd3600033f0 con 0x7fd38006c070 2022-03-21T13:54:10.409 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 >> v2:172.21.15.171:3300/0 conn(0x7fd38006d480 msgr2=0x7fd3800c3710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-03-21T13:54:10.409 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 --2- 172.21.15.160:0/263824585 >> v2:172.21.15.171:3300/0 conn(0x7fd38006d480 0x7fd3800c3710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:10.410 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 >> v1:172.21.15.171:6789/0 conn(0x7fd3800c3c50 legacy=0x7fd3800c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:10.410 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380067380 con 0x7fd38006c070 2022-03-21T13:54:10.410 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7fd378001470 con 0x7fd38006c070 2022-03-21T13:54:10.411 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 >> v1:172.21.15.160:6789/0 conn(0x7fd38006c070 legacy=0x7fd38015f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:10.411 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3600038e0 0x7fd360003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:10.411 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd360004690 0x7fd360004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:10.411 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd360005040 0x7fd36000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:10.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800670a0 con 0x7fd360005040 2022-03-21T13:54:10.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36000bf60 con 0x7fd360004690 2022-03-21T13:54:10.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36000c120 con 0x7fd3600038e0 2022-03-21T13:54:10.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37ed9d700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd360005040 0x7fd36000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:10.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37e59c700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3600038e0 0x7fd360003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:10.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37dd9b700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd360004690 0x7fd360004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:10.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37ed9d700 1 -- 172.21.15.160:0/263824585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3600038e0 msgr2=0x7fd360003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:10.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37ed9d700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3600038e0 0x7fd360003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:10.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37ed9d700 1 -- 172.21.15.160:0/263824585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd360004690 msgr2=0x7fd360004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:10.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.406+0000 7fd37ed9d700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd360004690 0x7fd360004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:10.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.407+0000 7fd37ed9d700 1 -- 172.21.15.160:0/263824585 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3600033f0 con 0x7fd360005040 2022-03-21T13:54:10.416 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.407+0000 7fd37dd9b700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd360004690 0x7fd360004b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:10.416 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.407+0000 7fd37ed9d700 1 -- 172.21.15.160:0/263824585 reap_dead start 2022-03-21T13:54:10.416 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.407+0000 7fd37ed9d700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd360005040 0x7fd36000b8e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd378004f80 tx=0x7fd378008a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fc15fd06229e89 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:10.416 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.407+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780080e0 con 0x7fd360005040 2022-03-21T13:54:10.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.407+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd378008260 con 0x7fd360005040 2022-03-21T13:54:10.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.407+0000 7fd37d59a700 1 -- 172.21.15.160:0/263824585 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378008620 con 0x7fd360005040 2022-03-21T13:54:10.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.407+0000 7fd384b9a700 1 -- 172.21.15.160:0/263824585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd360005040 msgr2=0x7fd36000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:10.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.407+0000 7fd384b9a700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd360005040 0x7fd36000b8e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd378004f80 tx=0x7fd378008a90 comp rx=0 tx=0).stop 2022-03-21T13:54:10.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.408+0000 7fd384b9a700 1 -- 172.21.15.160:0/263824585 shutdown_connections 2022-03-21T13:54:10.418 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.408+0000 7fd384b9a700 1 --2- 172.21.15.160:0/263824585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd360005040 0x7fd36000b8e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:10.418 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.408+0000 7fd384b9a700 1 -- 172.21.15.160:0/263824585 >> 172.21.15.160:0/263824585 conn(0x7fd3800c9910 msgr2=0x7fd3800c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:10.418 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.408+0000 7fd384b9a700 1 -- 172.21.15.160:0/263824585 shutdown_connections 2022-03-21T13:54:10.419 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.408+0000 7fd384b9a700 1 -- 172.21.15.160:0/263824585 wait complete. 2022-03-21T13:54:10.426 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.409+0000 7fd384b9a700 1 Processor -- start 2022-03-21T13:54:10.426 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.409+0000 7fd384b9a700 1 -- start start 2022-03-21T13:54:10.427 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd384b9a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd360005040 0x7fd3800c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:10.427 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd384b9a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd380158800 0x7fd38014f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:10.428 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd384b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd380158c70 0x7fd38014f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:10.428 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd384b9a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800bf800 con 0x7fd380158c70 2022-03-21T13:54:10.428 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd384b9a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800be390 con 0x7fd380158800 2022-03-21T13:54:10.429 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd384b9a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800c54e0 con 0x7fd360005040 2022-03-21T13:54:10.429 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd37ed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd380158c70 0x7fd38014f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:10.430 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd37ed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd380158c70 0x7fd38014f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:55656/0 (socket says 172.21.15.160:55656) 2022-03-21T13:54:10.430 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd37ed9d700 1 -- 172.21.15.160:0/4286039586 learned_addr learned my addr 172.21.15.160:0/4286039586 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:10.430 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd37e59c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd360005040 0x7fd3800c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:10.430 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd37dd9b700 1 --2- 172.21.15.160:0/4286039586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd380158800 0x7fd38014f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:10.431 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd37ed9d700 1 -- 172.21.15.160:0/4286039586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd360005040 msgr2=0x7fd3800c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:10.431 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd37ed9d700 1 --2- 172.21.15.160:0/4286039586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd360005040 0x7fd3800c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:10.431 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd37ed9d700 1 -- 172.21.15.160:0/4286039586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd380158800 msgr2=0x7fd38014f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:10.431 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd37ed9d700 1 --2- 172.21.15.160:0/4286039586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd380158800 0x7fd38014f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:10.431 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.410+0000 7fd37ed9d700 1 -- 172.21.15.160:0/4286039586 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38015c450 con 0x7fd380158c70 2022-03-21T13:54:10.432 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.411+0000 7fd37ed9d700 1 --2- 172.21.15.160:0/4286039586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd380158c70 0x7fd38014f6e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3800bca10 tx=0x7fd378016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:10.432 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.411+0000 7fd3767fc700 1 -- 172.21.15.160:0/4286039586 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378008a90 con 0x7fd380158c70 2022-03-21T13:54:10.432 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.411+0000 7fd384b9a700 1 -- 172.21.15.160:0/4286039586 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3800bfa50 con 0x7fd380158c70 2022-03-21T13:54:10.432 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.411+0000 7fd384b9a700 1 -- 172.21.15.160:0/4286039586 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3801582e0 con 0x7fd380158c70 2022-03-21T13:54:10.433 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.411+0000 7fd3767fc700 1 -- 172.21.15.160:0/4286039586 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3780080e0 con 0x7fd380158c70 2022-03-21T13:54:10.433 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.411+0000 7fd3767fc700 1 -- 172.21.15.160:0/4286039586 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378001b80 con 0x7fd380158c70 2022-03-21T13:54:10.433 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.412+0000 7fd3767fc700 1 -- 172.21.15.160:0/4286039586 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fd378029030 con 0x7fd380158c70 2022-03-21T13:54:10.433 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.412+0000 7fd3767fc700 1 -- 172.21.15.160:0/4286039586 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd378015770 con 0x7fd380158c70 2022-03-21T13:54:10.433 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.412+0000 7fd384b9a700 1 -- 172.21.15.160:0/4286039586 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3800be130 con 0x7fd380158c70 2022-03-21T13:54:10.434 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.417+0000 7fd3767fc700 1 -- 172.21.15.160:0/4286039586 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7fd378031060 con 0x7fd380158c70 2022-03-21T13:54:10.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.489+0000 7fd384b9a700 1 -- 172.21.15.160:0/4286039586 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd3801584f0 con 0x7fd380158c70 2022-03-21T13:54:10.497 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.496+0000 7fd3767fc700 1 -- 172.21.15.160:0/4286039586 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd378027070 con 0x7fd380158c70 2022-03-21T13:54:10.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.497+0000 7fd384b9a700 1 -- 172.21.15.160:0/4286039586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd380158c70 msgr2=0x7fd38014f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:10.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.497+0000 7fd384b9a700 1 --2- 172.21.15.160:0/4286039586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd380158c70 0x7fd38014f6e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3800bca10 tx=0x7fd378016000 comp rx=0 tx=0).stop 2022-03-21T13:54:10.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.497+0000 7fd384b9a700 1 -- 172.21.15.160:0/4286039586 shutdown_connections 2022-03-21T13:54:10.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.497+0000 7fd384b9a700 1 --2- 172.21.15.160:0/4286039586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd380158c70 0x7fd38014f6e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:10.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.497+0000 7fd384b9a700 1 --2- 172.21.15.160:0/4286039586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd360005040 0x7fd3800c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:10.500 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.497+0000 7fd384b9a700 1 --2- 172.21.15.160:0/4286039586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd380158800 0x7fd38014f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:10.500 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.497+0000 7fd384b9a700 1 -- 172.21.15.160:0/4286039586 >> 172.21.15.160:0/4286039586 conn(0x7fd3800c9910 msgr2=0x7fd3800c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:10.500 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.497+0000 7fd384b9a700 1 -- 172.21.15.160:0/4286039586 shutdown_connections 2022-03-21T13:54:10.501 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:10.497+0000 7fd384b9a700 1 -- 172.21.15.160:0/4286039586 wait complete. 2022-03-21T13:54:10.501 INFO:teuthology.orchestra.run.smithi160.stderr:adjusted tunables profile to default 2022-03-21T13:54:10.510 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-03-21T13:54:10.511 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:10.511 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-03-21T13:54:10.517 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:10.517+0000 7f7efbfd2000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-03-21T13:54:10.536 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:10.536 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-03-21T13:54:10.599 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:10.600 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-03-21T13:54:10.651 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:10.650+0000 7f7efbfd2000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-03-21T13:54:10.663 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2022-03-21T13:54:10.664 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-03-21T13:54:10.727 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:10.728 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-03-21T13:54:10.732 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:10.731+0000 7f7efbfd2000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-03-21T13:54:10.752 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:10.753 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-03-21T13:54:10.816 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:10.816 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-03-21T13:54:10.869 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:10.869+0000 7f7efbfd2000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-03-21T13:54:10.880 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-03-21T13:54:10.881 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-03-21T13:54:10.897 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:10.896+0000 7fca1df38000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-03-21T13:54:10.920 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 828ac39d-86ad-44a1-bb66-c99786642970 0 2022-03-21T13:54:11.030 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:11.029+0000 7fca1df38000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-03-21T13:54:11.059 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:11.059+0000 7f7efbfd2000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-03-21T13:54:11.074 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.074+0000 7f1aabb21700 1 Processor -- start 2022-03-21T13:54:11.074 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.074+0000 7f1aabb21700 1 -- start start 2022-03-21T13:54:11.077 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aabb21700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1aa4158350 0x7f1aa4158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.077 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aabb21700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa40c4ec0 con 0x7f1aa406ae30 2022-03-21T13:54:11.078 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aabb21700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa40c53d0 con 0x7f1aa40c7400 2022-03-21T13:54:11.078 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aabb21700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa40c5a10 con 0x7f1aa4158350 2022-03-21T13:54:11.078 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aa98bd700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1aa4158350 0x7f1aa4158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.078 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aa90bc700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f1aa40c7400 0x7f1aa406a720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52288/0 (socket says 172.21.15.171:52288) 2022-03-21T13:54:11.079 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aa90bc700 1 -- 172.21.15.171:0/1412628032 learned_addr learned my addr 172.21.15.171:0/1412628032 (peer_addr_for_me v1:172.21.15.171:0/0) 2022-03-21T13:54:11.079 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aa88bb700 1 -- 172.21.15.171:0/1412628032 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864236160 0 0) 0x7f1aa40c53d0 con 0x7f1aa40c7400 2022-03-21T13:54:11.079 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aa88bb700 1 -- 172.21.15.171:0/1412628032 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a8c0033f0 con 0x7f1aa40c7400 2022-03-21T13:54:11.079 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aa98bd700 1 -- 172.21.15.171:0/1412628032 >> v1:172.21.15.171:6789/0 conn(0x7f1aa40c7400 legacy=0x7f1aa406a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.080 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aa98bd700 1 -- 172.21.15.171:0/1412628032 >> v1:172.21.15.160:6789/0 conn(0x7f1aa406ae30 legacy=0x7f1aa40c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.080 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aa98bd700 1 -- 172.21.15.171:0/1412628032 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa406a290 con 0x7f1aa4158350 2022-03-21T13:54:11.080 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aa98bd700 1 --2- 172.21.15.171:0/1412628032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4158350 0x7f1aa4158720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009760 tx=0x7f1aa0009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18957e181abd15ce server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:11.080 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.075+0000 7f1aa88bb700 1 -- 172.21.15.171:0/1412628032 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0011630 con 0x7f1aa4158350 2022-03-21T13:54:11.081 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.076+0000 7f1aa88bb700 1 -- 172.21.15.171:0/1412628032 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa0011790 con 0x7f1aa4158350 2022-03-21T13:54:11.081 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.076+0000 7f1aa88bb700 1 -- 172.21.15.171:0/1412628032 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0011b30 con 0x7f1aa4158350 2022-03-21T13:54:11.081 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.076+0000 7f1aabb21700 1 -- 172.21.15.171:0/1412628032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4158350 msgr2=0x7f1aa4158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.081 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.076+0000 7f1aabb21700 1 --2- 172.21.15.171:0/1412628032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4158350 0x7f1aa4158720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009760 tx=0x7f1aa0009060 comp rx=0 tx=0).stop 2022-03-21T13:54:11.081 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.076+0000 7f1aabb21700 1 -- 172.21.15.171:0/1412628032 shutdown_connections 2022-03-21T13:54:11.082 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.076+0000 7f1aabb21700 1 --2- 172.21.15.171:0/1412628032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4158350 0x7f1aa4158720 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.082 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.076+0000 7f1aabb21700 1 -- 172.21.15.171:0/1412628032 >> 172.21.15.171:0/1412628032 conn(0x7f1aa40cb000 msgr2=0x7f1aa40cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:11.082 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.076+0000 7f1aabb21700 1 -- 172.21.15.171:0/1412628032 shutdown_connections 2022-03-21T13:54:11.082 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.076+0000 7f1aabb21700 1 -- 172.21.15.171:0/1412628032 wait complete. 2022-03-21T13:54:11.086 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.077+0000 7f1aabb21700 1 Processor -- start 2022-03-21T13:54:11.086 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.077+0000 7f1aabb21700 1 -- start start 2022-03-21T13:54:11.086 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aabb21700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa406ae30 0x7f1aa414b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.086 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aabb21700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa40c7400 0x7f1aa4150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.087 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aabb21700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1aa4158350 0x7f1aa4151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.087 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aabb21700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4156b30 con 0x7f1aa4158350 2022-03-21T13:54:11.087 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aabb21700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa414d460 con 0x7f1aa40c7400 2022-03-21T13:54:11.087 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aabb21700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa414d720 con 0x7f1aa406ae30 2022-03-21T13:54:11.087 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aa98bd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa406ae30 0x7f1aa414b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.088 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aa90bc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa40c7400 0x7f1aa4150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.088 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aa98bd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa406ae30 0x7f1aa414b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:52658/0 (socket says 172.21.15.171:52658) 2022-03-21T13:54:11.088 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aa98bd700 1 -- 172.21.15.171:0/3757849566 learned_addr learned my addr 172.21.15.171:0/3757849566 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:11.088 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aaa0be700 1 --2- 172.21.15.171:0/3757849566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1aa4158350 0x7f1aa4151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.089 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aa98bd700 1 -- 172.21.15.171:0/3757849566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa40c7400 msgr2=0x7f1aa4150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.089 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aa98bd700 1 --2- 172.21.15.171:0/3757849566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa40c7400 0x7f1aa4150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.089 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aa98bd700 1 -- 172.21.15.171:0/3757849566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1aa4158350 msgr2=0x7f1aa4151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.090 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.078+0000 7f1aa98bd700 1 --2- 172.21.15.171:0/3757849566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1aa4158350 0x7f1aa4151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.090 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.079+0000 7f1aa98bd700 1 -- 172.21.15.171:0/3757849566 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00092a0 con 0x7f1aa406ae30 2022-03-21T13:54:11.090 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.079+0000 7f1aa98bd700 1 --2- 172.21.15.171:0/3757849566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa406ae30 0x7f1aa414b820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4063e50 tx=0x7f1aa0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:11.090 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.079+0000 7f1a91ffb700 1 -- 172.21.15.171:0/3757849566 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0000bc0 con 0x7f1aa406ae30 2022-03-21T13:54:11.090 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.079+0000 7f1a91ffb700 1 -- 172.21.15.171:0/3757849566 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa0011900 con 0x7f1aa406ae30 2022-03-21T13:54:11.091 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.079+0000 7f1aabb21700 1 -- 172.21.15.171:0/3757849566 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa4155f20 con 0x7f1aa406ae30 2022-03-21T13:54:11.091 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.079+0000 7f1a91ffb700 1 -- 172.21.15.171:0/3757849566 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0000d20 con 0x7f1aa406ae30 2022-03-21T13:54:11.091 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.079+0000 7f1aabb21700 1 -- 172.21.15.171:0/3757849566 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa41564e0 con 0x7f1aa406ae30 2022-03-21T13:54:11.091 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.079+0000 7f1a91ffb700 1 -- 172.21.15.171:0/3757849566 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f1aa002c030 con 0x7f1aa406ae30 2022-03-21T13:54:11.092 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.079+0000 7f1a91ffb700 1 -- 172.21.15.171:0/3757849566 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1aa002f440 con 0x7f1aa406ae30 2022-03-21T13:54:11.092 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.080+0000 7f1aabb21700 1 -- 172.21.15.171:0/3757849566 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa4070ae0 con 0x7f1aa406ae30 2022-03-21T13:54:11.092 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.082+0000 7f1a91ffb700 1 -- 172.21.15.171:0/3757849566 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f1aa002a070 con 0x7f1aa406ae30 2022-03-21T13:54:11.112 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:11.111+0000 7fca1df38000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-03-21T13:54:11.159 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:11.159+0000 7f7efbfd2000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-03-21T13:54:11.164 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.164+0000 7f1aabb21700 1 -- 172.21.15.171:0/3757849566 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "828ac39d-86ad-44a1-bb66-c99786642970", "id": 0} v 0) v1 -- 0x7f1aa4157f40 con 0x7f1aa406ae30 2022-03-21T13:54:11.169 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.169+0000 7f1a91ffb700 1 -- 172.21.15.171:0/3757849566 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "828ac39d-86ad-44a1-bb66-c99786642970", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1aa0015020 con 0x7f1aa406ae30 2022-03-21T13:54:11.170 INFO:teuthology.orchestra.run.smithi171.stdout:0 2022-03-21T13:54:11.171 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.170+0000 7f1aabb21700 1 -- 172.21.15.171:0/3757849566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa406ae30 msgr2=0x7f1aa414b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.172 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.170+0000 7f1aabb21700 1 --2- 172.21.15.171:0/3757849566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa406ae30 0x7f1aa414b820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4063e50 tx=0x7f1aa0017000 comp rx=0 tx=0).stop 2022-03-21T13:54:11.172 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.170+0000 7f1aabb21700 1 -- 172.21.15.171:0/3757849566 shutdown_connections 2022-03-21T13:54:11.172 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.170+0000 7f1aabb21700 1 --2- 172.21.15.171:0/3757849566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1aa4158350 0x7f1aa4151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.172 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.170+0000 7f1aabb21700 1 --2- 172.21.15.171:0/3757849566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa406ae30 0x7f1aa414b820 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.173 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.170+0000 7f1aabb21700 1 --2- 172.21.15.171:0/3757849566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa40c7400 0x7f1aa4150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.173 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.170+0000 7f1aabb21700 1 -- 172.21.15.171:0/3757849566 >> 172.21.15.171:0/3757849566 conn(0x7f1aa40cb000 msgr2=0x7f1aa40cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:11.173 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.170+0000 7f1aabb21700 1 -- 172.21.15.171:0/3757849566 shutdown_connections 2022-03-21T13:54:11.173 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.170+0000 7f1aabb21700 1 -- 172.21.15.171:0/3757849566 wait complete. 2022-03-21T13:54:11.182 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 464764e2-a47e-43c0-8c93-b6bfd10ba526 1 2022-03-21T13:54:11.254 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:11.254+0000 7fca1df38000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-03-21T13:54:11.296 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.295+0000 7f173456b700 1 Processor -- start 2022-03-21T13:54:11.296 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.295+0000 7f173456b700 1 -- start start 2022-03-21T13:54:11.300 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f173456b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f172c0bf3d0 0x7f172c0c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.300 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f173456b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172c0c1830 con 0x7f172c0c2e10 2022-03-21T13:54:11.300 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f173456b700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172c06c230 con 0x7f172c06c6c0 2022-03-21T13:54:11.300 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f173456b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172c0c1cc0 con 0x7f172c0bf3d0 2022-03-21T13:54:11.301 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f1732b08700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f172c06c6c0 0x7f172c06cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52300/0 (socket says 172.21.15.171:52300) 2022-03-21T13:54:11.301 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f1732b08700 1 -- 172.21.15.171:0/1508834962 learned_addr learned my addr 172.21.15.171:0/1508834962 (peer_addr_for_me v1:172.21.15.171:0/0) 2022-03-21T13:54:11.301 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f1732307700 1 --2- 172.21.15.171:0/1508834962 >> v2:172.21.15.160:3300/0 conn(0x7f172c0bf3d0 0x7f172c0c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.301 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f1731305700 1 -- 172.21.15.171:0/1508834962 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463776546 0 0) 0x7f172c06c230 con 0x7f172c06c6c0 2022-03-21T13:54:11.301 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f1731305700 1 -- 172.21.15.171:0/1508834962 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17140033f0 con 0x7f172c06c6c0 2022-03-21T13:54:11.302 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f1731305700 1 -- 172.21.15.171:0/1508834962 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949942517 0 0) 0x7f172c0c1830 con 0x7f172c0c2e10 2022-03-21T13:54:11.302 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f1731305700 1 -- 172.21.15.171:0/1508834962 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f172c06c230 con 0x7f172c0c2e10 2022-03-21T13:54:11.302 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f1732307700 1 -- 172.21.15.171:0/1508834962 >> v1:172.21.15.171:6789/0 conn(0x7f172c06c6c0 legacy=0x7f172c06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.302 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f1732307700 1 -- 172.21.15.171:0/1508834962 >> v1:172.21.15.160:6789/0 conn(0x7f172c0c2e10 legacy=0x7f172c0c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.303 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.297+0000 7f1732307700 1 -- 172.21.15.171:0/1508834962 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c0c56e0 con 0x7f172c0bf3d0 2022-03-21T13:54:11.303 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.298+0000 7f1732307700 1 --2- 172.21.15.171:0/1508834962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0bf3d0 0x7f172c0c3710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1728009760 tx=0x7f1728009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393047873c8fc1a1 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:11.303 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.298+0000 7f1731305700 1 -- 172.21.15.171:0/1508834962 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17280105b0 con 0x7f172c0bf3d0 2022-03-21T13:54:11.303 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.298+0000 7f1731305700 1 -- 172.21.15.171:0/1508834962 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1728010710 con 0x7f172c0bf3d0 2022-03-21T13:54:11.303 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.298+0000 7f1731305700 1 -- 172.21.15.171:0/1508834962 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728010a90 con 0x7f172c0bf3d0 2022-03-21T13:54:11.304 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.298+0000 7f173456b700 1 -- 172.21.15.171:0/1508834962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0bf3d0 msgr2=0x7f172c0c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.304 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.298+0000 7f173456b700 1 --2- 172.21.15.171:0/1508834962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0bf3d0 0x7f172c0c3710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1728009760 tx=0x7f1728009060 comp rx=0 tx=0).stop 2022-03-21T13:54:11.304 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.298+0000 7f173456b700 1 -- 172.21.15.171:0/1508834962 shutdown_connections 2022-03-21T13:54:11.304 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.298+0000 7f173456b700 1 --2- 172.21.15.171:0/1508834962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0bf3d0 0x7f172c0c3710 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.305 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.298+0000 7f173456b700 1 -- 172.21.15.171:0/1508834962 >> 172.21.15.171:0/1508834962 conn(0x7f172c0c9910 msgr2=0x7f172c0c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:11.305 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.298+0000 7f173456b700 1 -- 172.21.15.171:0/1508834962 shutdown_connections 2022-03-21T13:54:11.305 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.298+0000 7f173456b700 1 -- 172.21.15.171:0/1508834962 wait complete. 2022-03-21T13:54:11.308 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f173456b700 1 Processor -- start 2022-03-21T13:54:11.308 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f173456b700 1 -- start start 2022-03-21T13:54:11.309 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f173456b700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f172c06c6c0 0x7f172c151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.309 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f173456b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f172c0bf3d0 0x7f172c14fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.309 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f173456b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0c2e10 0x7f172c14cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.309 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f173456b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c150e00 con 0x7f172c0c2e10 2022-03-21T13:54:11.310 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f173456b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c14f9b0 con 0x7f172c0bf3d0 2022-03-21T13:54:11.310 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f173456b700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172c14f6d0 con 0x7f172c06c6c0 2022-03-21T13:54:11.310 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f1731b06700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f172c0bf3d0 0x7f172c14fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.310 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f1731b06700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f172c0bf3d0 0x7f172c14fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:46834/0 (socket says 172.21.15.171:46834) 2022-03-21T13:54:11.311 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f1731b06700 1 -- 172.21.15.171:0/470367433 learned_addr learned my addr 172.21.15.171:0/470367433 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:11.311 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f1732307700 1 --2- 172.21.15.171:0/470367433 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f172c06c6c0 0x7f172c151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.311 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.300+0000 7f1732b08700 1 --2- 172.21.15.171:0/470367433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0c2e10 0x7f172c14cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.311 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f1731b06700 1 -- 172.21.15.171:0/470367433 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f172c06c6c0 msgr2=0x7f172c151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.312 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f1731b06700 1 --2- 172.21.15.171:0/470367433 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f172c06c6c0 0x7f172c151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.312 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f1731b06700 1 -- 172.21.15.171:0/470367433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0c2e10 msgr2=0x7f172c14cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.312 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f1731b06700 1 --2- 172.21.15.171:0/470367433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0c2e10 0x7f172c14cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.312 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f1731b06700 1 -- 172.21.15.171:0/470367433 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280092a0 con 0x7f172c0bf3d0 2022-03-21T13:54:11.312 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f1731b06700 1 --2- 172.21.15.171:0/470367433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f172c0bf3d0 0x7f172c14fcd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c440 tx=0x7f171c007c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:11.313 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f171a7fc700 1 -- 172.21.15.171:0/470367433 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c00ce80 con 0x7f172c0bf3d0 2022-03-21T13:54:11.313 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f171a7fc700 1 -- 172.21.15.171:0/470367433 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c0050d0 con 0x7f172c0bf3d0 2022-03-21T13:54:11.313 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f173456b700 1 -- 172.21.15.171:0/470367433 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172c1507b0 con 0x7f172c0bf3d0 2022-03-21T13:54:11.313 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f171a7fc700 1 -- 172.21.15.171:0/470367433 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c011590 con 0x7f172c0bf3d0 2022-03-21T13:54:11.314 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f173456b700 1 -- 172.21.15.171:0/470367433 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172c166d40 con 0x7f172c0bf3d0 2022-03-21T13:54:11.314 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f171a7fc700 1 -- 172.21.15.171:0/470367433 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f171c019030 con 0x7f172c0bf3d0 2022-03-21T13:54:11.314 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.301+0000 7f171a7fc700 1 -- 172.21.15.171:0/470367433 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f171c003af0 con 0x7f172c0bf3d0 2022-03-21T13:54:11.314 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.302+0000 7f173456b700 1 -- 172.21.15.171:0/470367433 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172c150c50 con 0x7f172c0bf3d0 2022-03-21T13:54:11.314 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.304+0000 7f171a7fc700 1 -- 172.21.15.171:0/470367433 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f171c017070 con 0x7f172c0bf3d0 2022-03-21T13:54:11.386 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.386+0000 7f173456b700 1 -- 172.21.15.171:0/470367433 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "464764e2-a47e-43c0-8c93-b6bfd10ba526", "id": 1} v 0) v1 -- 0x7f172c0c0cb0 con 0x7f172c0bf3d0 2022-03-21T13:54:11.392 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.391+0000 7f171a7fc700 1 -- 172.21.15.171:0/470367433 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "464764e2-a47e-43c0-8c93-b6bfd10ba526", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f171c011da0 con 0x7f172c0bf3d0 2022-03-21T13:54:11.392 INFO:teuthology.orchestra.run.smithi171.stdout:1 2022-03-21T13:54:11.394 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.392+0000 7f173456b700 1 -- 172.21.15.171:0/470367433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f172c0bf3d0 msgr2=0x7f172c14fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.394 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.392+0000 7f173456b700 1 --2- 172.21.15.171:0/470367433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f172c0bf3d0 0x7f172c14fcd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c440 tx=0x7f171c007c70 comp rx=0 tx=0).stop 2022-03-21T13:54:11.394 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.392+0000 7f173456b700 1 -- 172.21.15.171:0/470367433 shutdown_connections 2022-03-21T13:54:11.394 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.392+0000 7f173456b700 1 --2- 172.21.15.171:0/470367433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0c2e10 0x7f172c14cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.395 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.392+0000 7f173456b700 1 --2- 172.21.15.171:0/470367433 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f172c06c6c0 0x7f172c151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.395 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.392+0000 7f173456b700 1 --2- 172.21.15.171:0/470367433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f172c0bf3d0 0x7f172c14fcd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.395 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.392+0000 7f173456b700 1 -- 172.21.15.171:0/470367433 >> 172.21.15.171:0/470367433 conn(0x7f172c0c9910 msgr2=0x7f172c153600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:11.395 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.392+0000 7f173456b700 1 -- 172.21.15.171:0/470367433 shutdown_connections 2022-03-21T13:54:11.395 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.392+0000 7f173456b700 1 -- 172.21.15.171:0/470367433 wait complete. 2022-03-21T13:54:11.405 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 4dbfea57-14b6-4c67-8312-fc7d71ef77a6 2 2022-03-21T13:54:11.460 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:11.459+0000 7fca1df38000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-03-21T13:54:11.512 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:11.511+0000 7f7efbfd2000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-03-21T13:54:11.519 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.519+0000 7f89f6514700 1 Processor -- start 2022-03-21T13:54:11.520 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.519+0000 7f89f6514700 1 -- start start 2022-03-21T13:54:11.523 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f6514700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f89f014ec50 0x7f89f006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.523 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f6514700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f89f00c3530 0x7f89f00c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.523 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f6514700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f00677f0 con 0x7f89f0157ff0 2022-03-21T13:54:11.524 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f6514700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f0067a40 con 0x7f89f00c3530 2022-03-21T13:54:11.524 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f6514700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f0067d20 con 0x7f89f014ec50 2022-03-21T13:54:11.524 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f5512700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f89f014ec50 0x7f89f006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.524 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f5512700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f89f014ec50 0x7f89f006ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:46838/0 (socket says 172.21.15.171:46838) 2022-03-21T13:54:11.525 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f5d13700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f89f0157ff0 0x7f89f0158470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52310/0 (socket says 172.21.15.171:52310) 2022-03-21T13:54:11.525 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f5512700 1 -- 172.21.15.171:0/3928609283 learned_addr learned my addr 172.21.15.171:0/3928609283 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:11.525 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f4d11700 1 --2- 172.21.15.171:0/3928609283 >> v2:172.21.15.160:3300/0 conn(0x7f89f00c3530 0x7f89f00c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.525 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f5512700 1 -- 172.21.15.171:0/3928609283 >> v2:172.21.15.160:3300/0 conn(0x7f89f00c3530 msgr2=0x7f89f00c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:11.526 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f5512700 1 --2- 172.21.15.171:0/3928609283 >> v2:172.21.15.160:3300/0 conn(0x7f89f00c3530 0x7f89f00c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.526 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f5512700 1 -- 172.21.15.171:0/3928609283 >> v1:172.21.15.171:6789/0 conn(0x7f89f0157ff0 legacy=0x7f89f0158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.526 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f5512700 1 -- 172.21.15.171:0/3928609283 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f0068000 con 0x7f89f014ec50 2022-03-21T13:54:11.526 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89f5512700 1 --2- 172.21.15.171:0/3928609283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f014ec50 0x7f89f006ca80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f89f006ae70 tx=0x7f89ec0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fa0d6a772562503 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:11.527 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.520+0000 7f89dffff700 1 -- 172.21.15.171:0/3928609283 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec004030 con 0x7f89f014ec50 2022-03-21T13:54:11.527 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.521+0000 7f89dffff700 1 -- 172.21.15.171:0/3928609283 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec004190 con 0x7f89f014ec50 2022-03-21T13:54:11.527 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.521+0000 7f89dffff700 1 -- 172.21.15.171:0/3928609283 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec011630 con 0x7f89f014ec50 2022-03-21T13:54:11.527 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.521+0000 7f89f6514700 1 -- 172.21.15.171:0/3928609283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f014ec50 msgr2=0x7f89f006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.528 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.521+0000 7f89f6514700 1 --2- 172.21.15.171:0/3928609283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f014ec50 0x7f89f006ca80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f89f006ae70 tx=0x7f89ec0090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.528 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.521+0000 7f89f6514700 1 -- 172.21.15.171:0/3928609283 shutdown_connections 2022-03-21T13:54:11.528 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.521+0000 7f89f6514700 1 --2- 172.21.15.171:0/3928609283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f014ec50 0x7f89f006ca80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.528 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.521+0000 7f89f6514700 1 --2- 172.21.15.171:0/3928609283 >> v2:172.21.15.160:3300/0 conn(0x7f89f00c3530 0x7f89f00c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.528 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.521+0000 7f89f6514700 1 -- 172.21.15.171:0/3928609283 >> 172.21.15.171:0/3928609283 conn(0x7f89f00c5700 msgr2=0x7f89f00c5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:11.529 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.521+0000 7f89f6514700 1 -- 172.21.15.171:0/3928609283 shutdown_connections 2022-03-21T13:54:11.529 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.521+0000 7f89f6514700 1 -- 172.21.15.171:0/3928609283 wait complete. 2022-03-21T13:54:11.529 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.522+0000 7f89f6514700 1 Processor -- start 2022-03-21T13:54:11.529 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.522+0000 7f89f6514700 1 -- start start 2022-03-21T13:54:11.532 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.523+0000 7f89f6514700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f00c3530 0x7f89f00c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.532 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.523+0000 7f89f6514700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f014ec50 0x7f89f014d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.533 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.523+0000 7f89f6514700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f0157ff0 0x7f89f0165cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.533 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.523+0000 7f89f6514700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0168d30 con 0x7f89f014ec50 2022-03-21T13:54:11.533 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.523+0000 7f89f6514700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00c70c0 con 0x7f89f0157ff0 2022-03-21T13:54:11.533 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.523+0000 7f89f6514700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f015c430 con 0x7f89f00c3530 2022-03-21T13:54:11.533 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.523+0000 7f89f5512700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f00c3530 0x7f89f00c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.534 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.523+0000 7f89f5d13700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f0157ff0 0x7f89f0165cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.534 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.523+0000 7f89f5512700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f00c3530 0x7f89f00c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:52678/0 (socket says 172.21.15.171:52678) 2022-03-21T13:54:11.534 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.523+0000 7f89f5512700 1 -- 172.21.15.171:0/3801853983 learned_addr learned my addr 172.21.15.171:0/3801853983 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:11.534 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.523+0000 7f89f4d11700 1 --2- 172.21.15.171:0/3801853983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f014ec50 0x7f89f014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.535 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89f5d13700 1 -- 172.21.15.171:0/3801853983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f00c3530 msgr2=0x7f89f00c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.535 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89f5d13700 1 --2- 172.21.15.171:0/3801853983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f00c3530 0x7f89f00c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.535 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89f5d13700 1 -- 172.21.15.171:0/3801853983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f014ec50 msgr2=0x7f89f014d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.535 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89f5d13700 1 --2- 172.21.15.171:0/3801853983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f014ec50 0x7f89f014d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.536 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89f5d13700 1 -- 172.21.15.171:0/3801853983 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec009370 con 0x7f89f0157ff0 2022-03-21T13:54:11.536 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89f4d11700 1 --2- 172.21.15.171:0/3801853983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f014ec50 0x7f89f014d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:11.536 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89f5d13700 1 --2- 172.21.15.171:0/3801853983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f0157ff0 0x7f89f0165cd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c7f0 tx=0x7f89e8001530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:11.536 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89dd7fa700 1 -- 172.21.15.171:0/3801853983 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8005c70 con 0x7f89f0157ff0 2022-03-21T13:54:11.536 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89dd7fa700 1 -- 172.21.15.171:0/3801853983 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8005dd0 con 0x7f89f0157ff0 2022-03-21T13:54:11.537 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89f6514700 1 -- 172.21.15.171:0/3801853983 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f0168a50 con 0x7f89f0157ff0 2022-03-21T13:54:11.537 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89dd7fa700 1 -- 172.21.15.171:0/3801853983 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8007300 con 0x7f89f0157ff0 2022-03-21T13:54:11.537 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89f6514700 1 -- 172.21.15.171:0/3801853983 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f0156e70 con 0x7f89f0157ff0 2022-03-21T13:54:11.537 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89dd7fa700 1 -- 172.21.15.171:0/3801853983 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f89e8019030 con 0x7f89f0157ff0 2022-03-21T13:54:11.538 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.524+0000 7f89dd7fa700 1 -- 172.21.15.171:0/3801853983 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f89e801c440 con 0x7f89f0157ff0 2022-03-21T13:54:11.538 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.525+0000 7f89f6514700 1 -- 172.21.15.171:0/3801853983 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f00bf530 con 0x7f89f0157ff0 2022-03-21T13:54:11.538 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.527+0000 7f89dd7fa700 1 -- 172.21.15.171:0/3801853983 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f89f00bf530 con 0x7f89f0157ff0 2022-03-21T13:54:11.565 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:11.565+0000 7fca1df38000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-03-21T13:54:11.610 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.609+0000 7f89f6514700 1 -- 172.21.15.171:0/3801853983 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4dbfea57-14b6-4c67-8312-fc7d71ef77a6", "id": 2} v 0) v1 -- 0x7f89f0067130 con 0x7f89f0157ff0 2022-03-21T13:54:11.615 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.615+0000 7f89dd7fa700 1 -- 172.21.15.171:0/3801853983 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4dbfea57-14b6-4c67-8312-fc7d71ef77a6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89e8017070 con 0x7f89f0157ff0 2022-03-21T13:54:11.615 INFO:teuthology.orchestra.run.smithi171.stdout:2 2022-03-21T13:54:11.617 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.616+0000 7f89f6514700 1 -- 172.21.15.171:0/3801853983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f0157ff0 msgr2=0x7f89f0165cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.617 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.616+0000 7f89f6514700 1 --2- 172.21.15.171:0/3801853983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f0157ff0 0x7f89f0165cd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c7f0 tx=0x7f89e8001530 comp rx=0 tx=0).stop 2022-03-21T13:54:11.617 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.616+0000 7f89f6514700 1 -- 172.21.15.171:0/3801853983 shutdown_connections 2022-03-21T13:54:11.618 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.616+0000 7f89f6514700 1 --2- 172.21.15.171:0/3801853983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f0157ff0 0x7f89f0165cd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.618 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.616+0000 7f89f6514700 1 --2- 172.21.15.171:0/3801853983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f00c3530 0x7f89f00c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.618 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.616+0000 7f89f6514700 1 --2- 172.21.15.171:0/3801853983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f014ec50 0x7f89f014d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.618 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.616+0000 7f89f6514700 1 -- 172.21.15.171:0/3801853983 >> 172.21.15.171:0/3801853983 conn(0x7f89f00c5700 msgr2=0x7f89f0156760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:11.619 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.616+0000 7f89f6514700 1 -- 172.21.15.171:0/3801853983 shutdown_connections 2022-03-21T13:54:11.619 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.616+0000 7f89f6514700 1 -- 172.21.15.171:0/3801853983 wait complete. 2022-03-21T13:54:11.628 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new c53ed58d-a1f3-4783-8677-9348a1d103f5 3 2022-03-21T13:54:11.669 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:11.669+0000 7f7efbfd2000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-03-21T13:54:11.742 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.741+0000 7f148f59e700 1 Processor -- start 2022-03-21T13:54:11.742 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.741+0000 7f148f59e700 1 -- start start 2022-03-21T13:54:11.748 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148f59e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f149006d740 0x7f14900c5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.748 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148f59e700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f14900c7230 0x7f149006a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.749 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148f59e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f149006ad30 0x7f149006c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.749 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148f59e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1490159170 con 0x7f149006ad30 2022-03-21T13:54:11.749 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148f59e700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149006db10 con 0x7f14900c7230 2022-03-21T13:54:11.749 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148f59e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1490158280 con 0x7f149006d740 2022-03-21T13:54:11.750 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148dd9b700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f14900c7230 0x7f149006a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.750 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148e59c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f149006d740 0x7f14900c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.750 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148e59c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f149006d740 0x7f14900c5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:52684/0 (socket says 172.21.15.171:52684) 2022-03-21T13:54:11.750 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148e59c700 1 -- 172.21.15.171:0/2578851132 learned_addr learned my addr 172.21.15.171:0/2578851132 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:11.751 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148dd9b700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f14900c7230 0x7f149006a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:46850/0 (socket says 172.21.15.171:46850) 2022-03-21T13:54:11.751 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148ed9d700 1 --2- 172.21.15.171:0/2578851132 >> v2:172.21.15.160:3300/0 conn(0x7f149006ad30 0x7f149006c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.751 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148e59c700 1 -- 172.21.15.171:0/2578851132 >> v2:172.21.15.171:3300/0 conn(0x7f14900c7230 msgr2=0x7f149006a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:11.751 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148e59c700 1 --2- 172.21.15.171:0/2578851132 >> v2:172.21.15.171:3300/0 conn(0x7f14900c7230 0x7f149006a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.752 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148e59c700 1 -- 172.21.15.171:0/2578851132 >> v2:172.21.15.160:3300/0 conn(0x7f149006ad30 msgr2=0x7f149006c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:11.752 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148e59c700 1 --2- 172.21.15.171:0/2578851132 >> v2:172.21.15.160:3300/0 conn(0x7f149006ad30 0x7f149006c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.752 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148e59c700 1 -- 172.21.15.171:0/2578851132 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1490158560 con 0x7f149006d740 2022-03-21T13:54:11.753 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148ed9d700 1 --2- 172.21.15.171:0/2578851132 >> v2:172.21.15.160:3300/0 conn(0x7f149006ad30 0x7f149006c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:11.753 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.742+0000 7f148dd9b700 1 --2- 172.21.15.171:0/2578851132 >> v2:172.21.15.171:3300/0 conn(0x7f14900c7230 0x7f149006a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:11.753 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148e59c700 1 --2- 172.21.15.171:0/2578851132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f149006d740 0x7f14900c5720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f14900c8980 tx=0x7f14780090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cc04e2157926b63 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:11.753 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148d59a700 1 -- 172.21.15.171:0/2578851132 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478004030 con 0x7f149006d740 2022-03-21T13:54:11.754 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148d59a700 1 -- 172.21.15.171:0/2578851132 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1478004190 con 0x7f149006d740 2022-03-21T13:54:11.754 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148d59a700 1 -- 172.21.15.171:0/2578851132 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478011630 con 0x7f149006d740 2022-03-21T13:54:11.754 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148f59e700 1 -- 172.21.15.171:0/2578851132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f149006d740 msgr2=0x7f14900c5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.754 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148f59e700 1 --2- 172.21.15.171:0/2578851132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f149006d740 0x7f14900c5720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f14900c8980 tx=0x7f14780090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.755 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148f59e700 1 -- 172.21.15.171:0/2578851132 shutdown_connections 2022-03-21T13:54:11.755 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148f59e700 1 --2- 172.21.15.171:0/2578851132 >> v2:172.21.15.160:3300/0 conn(0x7f149006ad30 0x7f149006c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.755 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148f59e700 1 --2- 172.21.15.171:0/2578851132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f149006d740 0x7f14900c5720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.755 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148f59e700 1 --2- 172.21.15.171:0/2578851132 >> v2:172.21.15.171:3300/0 conn(0x7f14900c7230 0x7f149006a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.755 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148f59e700 1 -- 172.21.15.171:0/2578851132 >> 172.21.15.171:0/2578851132 conn(0x7f14900c7910 msgr2=0x7f14900c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:11.756 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148f59e700 1 -- 172.21.15.171:0/2578851132 shutdown_connections 2022-03-21T13:54:11.756 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.743+0000 7f148f59e700 1 -- 172.21.15.171:0/2578851132 wait complete. 2022-03-21T13:54:11.756 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.744+0000 7f148f59e700 1 Processor -- start 2022-03-21T13:54:11.756 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148f59e700 1 -- start start 2022-03-21T13:54:11.756 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148f59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f149006ad30 0x7f149014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.757 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148f59e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f149006d740 0x7f1490166610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.757 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148f59e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14900c7230 0x7f14900c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.757 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148f59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14900c46f0 con 0x7f149006ad30 2022-03-21T13:54:11.757 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148f59e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14901695a0 con 0x7f149006d740 2022-03-21T13:54:11.758 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148f59e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14900bd0a0 con 0x7f14900c7230 2022-03-21T13:54:11.758 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148ed9d700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14900c7230 0x7f14900c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.758 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148dd9b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f149006d740 0x7f1490166610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.758 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148dd9b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f149006d740 0x7f1490166610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:46858/0 (socket says 172.21.15.171:46858) 2022-03-21T13:54:11.758 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148ed9d700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14900c7230 0x7f14900c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:52690/0 (socket says 172.21.15.171:52690) 2022-03-21T13:54:11.759 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148dd9b700 1 -- 172.21.15.171:0/474744633 learned_addr learned my addr 172.21.15.171:0/474744633 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:11.759 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.745+0000 7f148e59c700 1 --2- 172.21.15.171:0/474744633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f149006ad30 0x7f149014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.759 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f148dd9b700 1 -- 172.21.15.171:0/474744633 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14900c7230 msgr2=0x7f14900c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.759 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f148dd9b700 1 --2- 172.21.15.171:0/474744633 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14900c7230 0x7f14900c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.760 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f148dd9b700 1 -- 172.21.15.171:0/474744633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f149006ad30 msgr2=0x7f149014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.760 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f148dd9b700 1 --2- 172.21.15.171:0/474744633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f149006ad30 0x7f149014ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.760 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f148dd9b700 1 -- 172.21.15.171:0/474744633 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800092a0 con 0x7f149006d740 2022-03-21T13:54:11.760 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f148ed9d700 1 --2- 172.21.15.171:0/474744633 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14900c7230 0x7f14900c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:11.760 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f148dd9b700 1 --2- 172.21.15.171:0/474744633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f149006d740 0x7f1490166610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f148000e930 tx=0x7f1480009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:11.761 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f14867fc700 1 -- 172.21.15.171:0/474744633 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480013680 con 0x7f149006d740 2022-03-21T13:54:11.761 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f14867fc700 1 -- 172.21.15.171:0/474744633 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14800137e0 con 0x7f149006d740 2022-03-21T13:54:11.761 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f14867fc700 1 -- 172.21.15.171:0/474744633 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480013b80 con 0x7f149006d740 2022-03-21T13:54:11.761 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f148f59e700 1 -- 172.21.15.171:0/474744633 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1478009370 con 0x7f149006d740 2022-03-21T13:54:11.762 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f148f59e700 1 -- 172.21.15.171:0/474744633 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14900bc770 con 0x7f149006d740 2022-03-21T13:54:11.762 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f14867fc700 1 -- 172.21.15.171:0/474744633 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f1480019030 con 0x7f149006d740 2022-03-21T13:54:11.762 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.746+0000 7f14867fc700 1 -- 172.21.15.171:0/474744633 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f14800065b0 con 0x7f149006d740 2022-03-21T13:54:11.762 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.747+0000 7f148f59e700 1 -- 172.21.15.171:0/474744633 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149004b760 con 0x7f149006d740 2022-03-21T13:54:11.763 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.749+0000 7f14867fc700 1 -- 172.21.15.171:0/474744633 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f1480021060 con 0x7f149006d740 2022-03-21T13:54:11.831 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.830+0000 7f148f59e700 1 -- 172.21.15.171:0/474744633 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c53ed58d-a1f3-4783-8677-9348a1d103f5", "id": 3} v 0) v1 -- 0x7f149006a9c0 con 0x7f149006d740 2022-03-21T13:54:11.838 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.838+0000 7f14867fc700 1 -- 172.21.15.171:0/474744633 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c53ed58d-a1f3-4783-8677-9348a1d103f5", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1480017070 con 0x7f149006d740 2022-03-21T13:54:11.839 INFO:teuthology.orchestra.run.smithi171.stdout:3 2022-03-21T13:54:11.840 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.839+0000 7f148f59e700 1 -- 172.21.15.171:0/474744633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f149006d740 msgr2=0x7f1490166610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.840 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.839+0000 7f148f59e700 1 --2- 172.21.15.171:0/474744633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f149006d740 0x7f1490166610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f148000e930 tx=0x7f1480009060 comp rx=0 tx=0).stop 2022-03-21T13:54:11.840 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.839+0000 7f148f59e700 1 -- 172.21.15.171:0/474744633 shutdown_connections 2022-03-21T13:54:11.841 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.839+0000 7f148f59e700 1 --2- 172.21.15.171:0/474744633 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14900c7230 0x7f14900c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.841 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.839+0000 7f148f59e700 1 --2- 172.21.15.171:0/474744633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f149006ad30 0x7f149014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.841 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.839+0000 7f148f59e700 1 --2- 172.21.15.171:0/474744633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f149006d740 0x7f1490166610 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.841 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.839+0000 7f148f59e700 1 -- 172.21.15.171:0/474744633 >> 172.21.15.171:0/474744633 conn(0x7f14900c7910 msgr2=0x7f149006c350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:11.842 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.839+0000 7f148f59e700 1 -- 172.21.15.171:0/474744633 shutdown_connections 2022-03-21T13:54:11.842 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.839+0000 7f148f59e700 1 -- 172.21.15.171:0/474744633 wait complete. 2022-03-21T13:54:11.852 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 5713dbd4-1736-4ebf-8102-e80f4db6bcc1 4 2022-03-21T13:54:11.874 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:11.874+0000 7f7efbfd2000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-03-21T13:54:11.917 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:11.916+0000 7fca1df38000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-03-21T13:54:11.965 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.964+0000 7fbf2f9f4700 1 Processor -- start 2022-03-21T13:54:11.965 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.964+0000 7fbf2f9f4700 1 -- start start 2022-03-21T13:54:11.968 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.965+0000 7fbf2f9f4700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbf2814eb10 0x7fbf2805dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.969 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.965+0000 7fbf2f9f4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf28158ca0 con 0x7fbf280c2440 2022-03-21T13:54:11.969 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.965+0000 7fbf2f9f4700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2805e1c0 con 0x7fbf2814eee0 2022-03-21T13:54:11.969 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.965+0000 7fbf2f9f4700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf280c1130 con 0x7fbf2814eb10 2022-03-21T13:54:11.969 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.965+0000 7fbf2cf8f700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fbf2814eee0 0x7fbf280c1d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52330/0 (socket says 172.21.15.171:52330) 2022-03-21T13:54:11.969 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.965+0000 7fbf2cf8f700 1 -- 172.21.15.171:0/422755398 learned_addr learned my addr 172.21.15.171:0/422755398 (peer_addr_for_me v1:172.21.15.171:0/0) 2022-03-21T13:54:11.970 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.965+0000 7fbf2d790700 1 --2- 172.21.15.171:0/422755398 >> v2:172.21.15.160:3300/0 conn(0x7fbf2814eb10 0x7fbf2805dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.970 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.965+0000 7fbf17fff700 1 -- 172.21.15.171:0/422755398 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627333867 0 0) 0x7fbf2805e1c0 con 0x7fbf2814eee0 2022-03-21T13:54:11.970 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.966+0000 7fbf17fff700 1 -- 172.21.15.171:0/422755398 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf100033f0 con 0x7fbf2814eee0 2022-03-21T13:54:11.970 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.966+0000 7fbf17fff700 1 -- 172.21.15.171:0/422755398 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611559615 0 0) 0x7fbf28158ca0 con 0x7fbf280c2440 2022-03-21T13:54:11.971 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.966+0000 7fbf17fff700 1 -- 172.21.15.171:0/422755398 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf2805e1c0 con 0x7fbf280c2440 2022-03-21T13:54:11.971 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.966+0000 7fbf2d790700 1 -- 172.21.15.171:0/422755398 >> v1:172.21.15.171:6789/0 conn(0x7fbf2814eee0 legacy=0x7fbf280c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.971 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.966+0000 7fbf2d790700 1 -- 172.21.15.171:0/422755398 >> v1:172.21.15.160:6789/0 conn(0x7fbf280c2440 legacy=0x7fbf28154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.971 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.966+0000 7fbf2d790700 1 -- 172.21.15.171:0/422755398 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf28158090 con 0x7fbf2814eb10 2022-03-21T13:54:11.972 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.966+0000 7fbf2d790700 1 --2- 172.21.15.171:0/422755398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf2814eb10 0x7fbf2805dc80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009760 tx=0x7fbf18009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191beff60dde9a84 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:11.972 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.966+0000 7fbf17fff700 1 -- 172.21.15.171:0/422755398 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf180105b0 con 0x7fbf2814eb10 2022-03-21T13:54:11.972 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.966+0000 7fbf17fff700 1 -- 172.21.15.171:0/422755398 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf18010710 con 0x7fbf2814eb10 2022-03-21T13:54:11.972 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.966+0000 7fbf17fff700 1 -- 172.21.15.171:0/422755398 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18010a90 con 0x7fbf2814eb10 2022-03-21T13:54:11.973 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.967+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/422755398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf2814eb10 msgr2=0x7fbf2805dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.973 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.967+0000 7fbf2f9f4700 1 --2- 172.21.15.171:0/422755398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf2814eb10 0x7fbf2805dc80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009760 tx=0x7fbf18009060 comp rx=0 tx=0).stop 2022-03-21T13:54:11.973 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.967+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/422755398 shutdown_connections 2022-03-21T13:54:11.973 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.967+0000 7fbf2f9f4700 1 --2- 172.21.15.171:0/422755398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf2814eb10 0x7fbf2805dc80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.973 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.967+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/422755398 >> 172.21.15.171:0/422755398 conn(0x7fbf280c3f20 msgr2=0x7fbf280c42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:11.974 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.967+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/422755398 shutdown_connections 2022-03-21T13:54:11.974 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.967+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/422755398 wait complete. 2022-03-21T13:54:11.974 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.968+0000 7fbf2f9f4700 1 Processor -- start 2022-03-21T13:54:11.974 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.968+0000 7fbf2f9f4700 1 -- start start 2022-03-21T13:54:11.977 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2f9f4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf280c2440 0x7fbf28159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.978 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2f9f4700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf2814eb10 0x7fbf280bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.978 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2f9f4700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf2814eee0 0x7fbf280bf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:11.978 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2f9f4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2814b490 con 0x7fbf280c2440 2022-03-21T13:54:11.978 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2f9f4700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280c5460 con 0x7fbf2814eb10 2022-03-21T13:54:11.979 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2f9f4700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280c5740 con 0x7fbf2814eee0 2022-03-21T13:54:11.979 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2cf8f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf2814eb10 0x7fbf280bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.979 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2df91700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf2814eee0 0x7fbf280bf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.979 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2cf8f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf2814eb10 0x7fbf280bf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:46866/0 (socket says 172.21.15.171:46866) 2022-03-21T13:54:11.980 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2cf8f700 1 -- 172.21.15.171:0/2222217725 learned_addr learned my addr 172.21.15.171:0/2222217725 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:11.980 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2d790700 1 --2- 172.21.15.171:0/2222217725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf280c2440 0x7fbf28159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:11.980 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2df91700 1 -- 172.21.15.171:0/2222217725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf2814eb10 msgr2=0x7fbf280bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.980 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2df91700 1 --2- 172.21.15.171:0/2222217725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf2814eb10 0x7fbf280bf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.981 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2df91700 1 -- 172.21.15.171:0/2222217725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf280c2440 msgr2=0x7fbf28159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:11.981 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2df91700 1 --2- 172.21.15.171:0/2222217725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf280c2440 0x7fbf28159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:11.981 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2df91700 1 -- 172.21.15.171:0/2222217725 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf180092a0 con 0x7fbf2814eee0 2022-03-21T13:54:11.981 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2cf8f700 1 --2- 172.21.15.171:0/2222217725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf2814eb10 0x7fbf280bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:11.982 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2d790700 1 --2- 172.21.15.171:0/2222217725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf280c2440 0x7fbf28159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:11.982 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2df91700 1 --2- 172.21.15.171:0/2222217725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf2814eee0 0x7fbf280bf910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c790 tx=0x7fbf20007ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:11.982 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf157fa700 1 -- 172.21.15.171:0/2222217725 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20003840 con 0x7fbf2814eee0 2022-03-21T13:54:11.983 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf157fa700 1 -- 172.21.15.171:0/2222217725 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf200039e0 con 0x7fbf2814eee0 2022-03-21T13:54:11.983 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/2222217725 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2814ab60 con 0x7fbf2814eee0 2022-03-21T13:54:11.983 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf157fa700 1 -- 172.21.15.171:0/2222217725 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20003da0 con 0x7fbf2814eee0 2022-03-21T13:54:11.983 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.969+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/2222217725 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2814b120 con 0x7fbf2814eee0 2022-03-21T13:54:11.983 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.970+0000 7fbf157fa700 1 -- 172.21.15.171:0/2222217725 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fbf20010050 con 0x7fbf2814eee0 2022-03-21T13:54:11.984 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.970+0000 7fbf157fa700 1 -- 172.21.15.171:0/2222217725 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fbf20012b90 con 0x7fbf2814eee0 2022-03-21T13:54:11.984 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.970+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/2222217725 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf280c33c0 con 0x7fbf2814eee0 2022-03-21T13:54:11.984 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:11.972+0000 7fbf157fa700 1 -- 172.21.15.171:0/2222217725 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7fbf200052e0 con 0x7fbf2814eee0 2022-03-21T13:54:12.037 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:12.036+0000 7f7efbfd2000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-03-21T13:54:12.081 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:12.080+0000 7fca1df38000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-03-21T13:54:12.089 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.088+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/2222217725 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5713dbd4-1736-4ebf-8102-e80f4db6bcc1", "id": 4} v 0) v1 -- 0x7fbf2806fc00 con 0x7fbf2814eee0 2022-03-21T13:54:12.092 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.092+0000 7fbf157fa700 1 -- 172.21.15.171:0/2222217725 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5713dbd4-1736-4ebf-8102-e80f4db6bcc1", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbf20005480 con 0x7fbf2814eee0 2022-03-21T13:54:12.093 INFO:teuthology.orchestra.run.smithi171.stdout:4 2022-03-21T13:54:12.095 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.093+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/2222217725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf2814eee0 msgr2=0x7fbf280bf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.095 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.093+0000 7fbf2f9f4700 1 --2- 172.21.15.171:0/2222217725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf2814eee0 0x7fbf280bf910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c790 tx=0x7fbf20007ee0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.096 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.093+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/2222217725 shutdown_connections 2022-03-21T13:54:12.096 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.093+0000 7fbf2f9f4700 1 --2- 172.21.15.171:0/2222217725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf2814eee0 0x7fbf280bf910 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.096 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.093+0000 7fbf2f9f4700 1 --2- 172.21.15.171:0/2222217725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf280c2440 0x7fbf28159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.097 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.093+0000 7fbf2f9f4700 1 --2- 172.21.15.171:0/2222217725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf2814eb10 0x7fbf280bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.097 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.093+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/2222217725 >> 172.21.15.171:0/2222217725 conn(0x7fbf280c3f20 msgr2=0x7fbf28146300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:12.097 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.093+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/2222217725 shutdown_connections 2022-03-21T13:54:12.098 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.093+0000 7fbf2f9f4700 1 -- 172.21.15.171:0/2222217725 wait complete. 2022-03-21T13:54:12.106 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new dfe21128-6ae6-4662-9f47-1bbb423a2232 5 2022-03-21T13:54:12.187 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:12.186+0000 7f7efbfd2000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-03-21T13:54:12.223 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.222+0000 7f749a9ca700 1 Processor -- start 2022-03-21T13:54:12.224 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.222+0000 7f749a9ca700 1 -- start start 2022-03-21T13:54:12.227 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.223+0000 7f749a9ca700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f749406c300 0x7f749406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.227 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.223+0000 7f749a9ca700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f74940c1420 0x7f74940c1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.227 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.223+0000 7f749a9ca700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7494152a20 con 0x7f74940c4f00 2022-03-21T13:54:12.227 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.223+0000 7f749a9ca700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74940c1d80 con 0x7f749406c300 2022-03-21T13:54:12.228 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.223+0000 7f749a9ca700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749406d970 con 0x7f74940c1420 2022-03-21T13:54:12.228 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.223+0000 7f7498f67700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f74940c1420 0x7f74940c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.228 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.223+0000 7f7498f67700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f74940c1420 0x7f74940c1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:46874/0 (socket says 172.21.15.171:46874) 2022-03-21T13:54:12.228 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.223+0000 7f7498f67700 1 -- 172.21.15.171:0/1646117985 learned_addr learned my addr 172.21.15.171:0/1646117985 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:12.229 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.223+0000 7f7493fff700 1 --2- 172.21.15.171:0/1646117985 >> v2:172.21.15.160:3300/0 conn(0x7f749406c300 0x7f749406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.229 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.224+0000 7f7492ffd700 1 -- 172.21.15.171:0/1646117985 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164711731 0 0) 0x7f7494152a20 con 0x7f74940c4f00 2022-03-21T13:54:12.229 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.224+0000 7f7498f67700 1 -- 172.21.15.171:0/1646117985 >> v2:172.21.15.160:3300/0 conn(0x7f749406c300 msgr2=0x7f749406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:12.229 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.224+0000 7f7498f67700 1 --2- 172.21.15.171:0/1646117985 >> v2:172.21.15.160:3300/0 conn(0x7f749406c300 0x7f749406c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.229 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.224+0000 7f7498f67700 1 -- 172.21.15.171:0/1646117985 >> v1:172.21.15.160:6789/0 conn(0x7f74940c4f00 legacy=0x7f74940672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.230 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.224+0000 7f7498f67700 1 -- 172.21.15.171:0/1646117985 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494067a00 con 0x7f74940c1420 2022-03-21T13:54:12.230 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.224+0000 7f7498f67700 1 --2- 172.21.15.171:0/1646117985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74940c1420 0x7f74940c1840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f749406b0f0 tx=0x7f748c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3099eb5acfee4e75 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:12.230 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.224+0000 7f7492ffd700 1 -- 172.21.15.171:0/1646117985 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c00e070 con 0x7f74940c1420 2022-03-21T13:54:12.230 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.224+0000 7f7492ffd700 1 -- 172.21.15.171:0/1646117985 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c00bab0 con 0x7f74940c1420 2022-03-21T13:54:12.230 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.224+0000 7f7492ffd700 1 -- 172.21.15.171:0/1646117985 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0092e0 con 0x7f74940c1420 2022-03-21T13:54:12.231 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.225+0000 7f749a9ca700 1 -- 172.21.15.171:0/1646117985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74940c1420 msgr2=0x7f74940c1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.231 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.225+0000 7f749a9ca700 1 --2- 172.21.15.171:0/1646117985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74940c1420 0x7f74940c1840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f749406b0f0 tx=0x7f748c009840 comp rx=0 tx=0).stop 2022-03-21T13:54:12.231 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.225+0000 7f749a9ca700 1 -- 172.21.15.171:0/1646117985 shutdown_connections 2022-03-21T13:54:12.231 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.225+0000 7f749a9ca700 1 --2- 172.21.15.171:0/1646117985 >> v2:172.21.15.160:3300/0 conn(0x7f749406c300 0x7f749406c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.232 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.225+0000 7f749a9ca700 1 --2- 172.21.15.171:0/1646117985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74940c1420 0x7f74940c1840 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.232 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.225+0000 7f749a9ca700 1 -- 172.21.15.171:0/1646117985 >> 172.21.15.171:0/1646117985 conn(0x7f74940c8820 msgr2=0x7f74940c47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:12.232 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.225+0000 7f749a9ca700 1 -- 172.21.15.171:0/1646117985 shutdown_connections 2022-03-21T13:54:12.232 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.225+0000 7f749a9ca700 1 -- 172.21.15.171:0/1646117985 wait complete. 2022-03-21T13:54:12.232 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.226+0000 7f749a9ca700 1 Processor -- start 2022-03-21T13:54:12.233 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.226+0000 7f749a9ca700 1 -- start start 2022-03-21T13:54:12.235 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f749a9ca700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f749406c300 0x7f749414e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.235 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f749a9ca700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74940c1420 0x7f7494166350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.236 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f749a9ca700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74940c4f00 0x7f74940c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.236 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f749a9ca700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7494165900 con 0x7f749406c300 2022-03-21T13:54:12.236 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f749a9ca700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749414d6d0 con 0x7f74940c1420 2022-03-21T13:54:12.236 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f749a9ca700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749414d950 con 0x7f74940c4f00 2022-03-21T13:54:12.237 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f74937fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74940c1420 0x7f7494166350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.237 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f7498f67700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74940c4f00 0x7f74940c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.237 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f74937fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74940c1420 0x7f7494166350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:46878/0 (socket says 172.21.15.171:46878) 2022-03-21T13:54:12.237 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f7493fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f749406c300 0x7f749414e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.237 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f74937fe700 1 -- 172.21.15.171:0/4114048746 learned_addr learned my addr 172.21.15.171:0/4114048746 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:12.238 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f74937fe700 1 -- 172.21.15.171:0/4114048746 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74940c4f00 msgr2=0x7f74940c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.238 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f74937fe700 1 --2- 172.21.15.171:0/4114048746 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74940c4f00 0x7f74940c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.238 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f74937fe700 1 -- 172.21.15.171:0/4114048746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f749406c300 msgr2=0x7f749414e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.238 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f74937fe700 1 --2- 172.21.15.171:0/4114048746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f749406c300 0x7f749414e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.239 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f74937fe700 1 -- 172.21.15.171:0/4114048746 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c009ae0 con 0x7f74940c1420 2022-03-21T13:54:12.239 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f7498f67700 1 --2- 172.21.15.171:0/4114048746 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74940c4f00 0x7f74940c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:12.239 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f7493fff700 1 --2- 172.21.15.171:0/4114048746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f749406c300 0x7f749414e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:12.239 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f74937fe700 1 --2- 172.21.15.171:0/4114048746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74940c1420 0x7f7494166350 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f748400c490 tx=0x7f7484007da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:12.240 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f747bfff700 1 -- 172.21.15.171:0/4114048746 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840050d0 con 0x7f74940c1420 2022-03-21T13:54:12.240 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f747bfff700 1 -- 172.21.15.171:0/4114048746 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7484005250 con 0x7f74940c1420 2022-03-21T13:54:12.240 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f749a9ca700 1 -- 172.21.15.171:0/4114048746 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749414dc30 con 0x7f74940c1420 2022-03-21T13:54:12.240 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f747bfff700 1 -- 172.21.15.171:0/4114048746 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484003710 con 0x7f74940c1420 2022-03-21T13:54:12.240 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.227+0000 7f749a9ca700 1 -- 172.21.15.171:0/4114048746 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7494165e30 con 0x7f74940c1420 2022-03-21T13:54:12.241 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.228+0000 7f747bfff700 1 -- 172.21.15.171:0/4114048746 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f7484019030 con 0x7f74940c1420 2022-03-21T13:54:12.241 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.228+0000 7f747bfff700 1 -- 172.21.15.171:0/4114048746 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f748401c440 con 0x7f74940c1420 2022-03-21T13:54:12.241 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.228+0000 7f749a9ca700 1 -- 172.21.15.171:0/4114048746 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7494166050 con 0x7f74940c1420 2022-03-21T13:54:12.241 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.230+0000 7f747bfff700 1 -- 172.21.15.171:0/4114048746 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f7484017070 con 0x7f74940c1420 2022-03-21T13:54:12.297 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:12.297+0000 7fca1df38000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-03-21T13:54:12.312 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.312+0000 7f749a9ca700 1 -- 172.21.15.171:0/4114048746 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dfe21128-6ae6-4662-9f47-1bbb423a2232", "id": 5} v 0) v1 -- 0x7f749406fc00 con 0x7f74940c1420 2022-03-21T13:54:12.315 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.315+0000 7f747bfff700 1 -- 172.21.15.171:0/4114048746 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dfe21128-6ae6-4662-9f47-1bbb423a2232", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f748401c8f0 con 0x7f74940c1420 2022-03-21T13:54:12.316 INFO:teuthology.orchestra.run.smithi171.stdout:5 2022-03-21T13:54:12.317 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.316+0000 7f749a9ca700 1 -- 172.21.15.171:0/4114048746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74940c1420 msgr2=0x7f7494166350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.318 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.316+0000 7f749a9ca700 1 --2- 172.21.15.171:0/4114048746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74940c1420 0x7f7494166350 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f748400c490 tx=0x7f7484007da0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.318 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.316+0000 7f749a9ca700 1 -- 172.21.15.171:0/4114048746 shutdown_connections 2022-03-21T13:54:12.318 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.316+0000 7f749a9ca700 1 --2- 172.21.15.171:0/4114048746 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74940c4f00 0x7f74940c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.318 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.316+0000 7f749a9ca700 1 --2- 172.21.15.171:0/4114048746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f749406c300 0x7f749414e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.319 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.316+0000 7f749a9ca700 1 --2- 172.21.15.171:0/4114048746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74940c1420 0x7f7494166350 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.319 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.316+0000 7f749a9ca700 1 -- 172.21.15.171:0/4114048746 >> 172.21.15.171:0/4114048746 conn(0x7f74940c8820 msgr2=0x7f74940c3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:12.319 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.316+0000 7f749a9ca700 1 -- 172.21.15.171:0/4114048746 shutdown_connections 2022-03-21T13:54:12.319 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.316+0000 7f749a9ca700 1 -- 172.21.15.171:0/4114048746 wait complete. 2022-03-21T13:54:12.328 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 24a9b956-5fa1-41bf-a689-0f048b7f19d8 6 2022-03-21T13:54:12.444 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.443+0000 7f64831f0700 1 Processor -- start 2022-03-21T13:54:12.445 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.444+0000 7f64831f0700 1 -- start start 2022-03-21T13:54:12.448 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.444+0000 7f64831f0700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c14eb10 0x7f647c05dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.448 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.444+0000 7f64831f0700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f647c0c2440 0x7f647c154be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.449 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.444+0000 7f64831f0700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c158ca0 con 0x7f647c14eee0 2022-03-21T13:54:12.449 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.444+0000 7f64831f0700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c0c1130 con 0x7f647c0c2440 2022-03-21T13:54:12.449 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.444+0000 7f64831f0700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c05e1c0 con 0x7f647c14eb10 2022-03-21T13:54:12.449 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.444+0000 7f648178d700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f647c0c2440 0x7f647c154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.450 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.444+0000 7f6480f8c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c14eb10 0x7f647c05dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.450 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f648178d700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f647c0c2440 0x7f647c154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:46886/0 (socket says 172.21.15.171:46886) 2022-03-21T13:54:12.450 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f6480f8c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c14eb10 0x7f647c05dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:52716/0 (socket says 172.21.15.171:52716) 2022-03-21T13:54:12.450 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f647bfff700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f647c14eee0 0x7f647c0c1d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52354/0 (socket says 172.21.15.171:52354) 2022-03-21T13:54:12.451 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f648178d700 1 -- 172.21.15.171:0/2964640582 learned_addr learned my addr 172.21.15.171:0/2964640582 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:12.451 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f6480f8c700 1 -- 172.21.15.171:0/2964640582 >> v2:172.21.15.171:3300/0 conn(0x7f647c0c2440 msgr2=0x7f647c154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:12.451 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f6480f8c700 1 --2- 172.21.15.171:0/2964640582 >> v2:172.21.15.171:3300/0 conn(0x7f647c0c2440 0x7f647c154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.451 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f6480f8c700 1 -- 172.21.15.171:0/2964640582 >> v1:172.21.15.171:6789/0 conn(0x7f647c14eee0 legacy=0x7f647c0c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.451 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f647b7fe700 1 -- 172.21.15.171:0/2964640582 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652900117 0 0) 0x7f647c158ca0 con 0x7f647c14eee0 2022-03-21T13:54:12.452 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f6480f8c700 1 -- 172.21.15.171:0/2964640582 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c158090 con 0x7f647c14eb10 2022-03-21T13:54:12.452 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f648178d700 1 --2- 172.21.15.171:0/2964640582 >> v2:172.21.15.171:3300/0 conn(0x7f647c0c2440 0x7f647c154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:12.452 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f6480f8c700 1 --2- 172.21.15.171:0/2964640582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c14eb10 0x7f647c05dc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6470009760 tx=0x7f6470009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f913a1918b5dfa2f server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:12.452 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f647b7fe700 1 -- 172.21.15.171:0/2964640582 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470011630 con 0x7f647c14eb10 2022-03-21T13:54:12.452 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f647b7fe700 1 -- 172.21.15.171:0/2964640582 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6470011790 con 0x7f647c14eb10 2022-03-21T13:54:12.453 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.445+0000 7f647b7fe700 1 -- 172.21.15.171:0/2964640582 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470011b50 con 0x7f647c14eb10 2022-03-21T13:54:12.453 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.446+0000 7f64831f0700 1 -- 172.21.15.171:0/2964640582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c14eb10 msgr2=0x7f647c05dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.453 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.446+0000 7f64831f0700 1 --2- 172.21.15.171:0/2964640582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c14eb10 0x7f647c05dc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6470009760 tx=0x7f6470009060 comp rx=0 tx=0).stop 2022-03-21T13:54:12.453 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.446+0000 7f64831f0700 1 -- 172.21.15.171:0/2964640582 shutdown_connections 2022-03-21T13:54:12.454 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.446+0000 7f64831f0700 1 --2- 172.21.15.171:0/2964640582 >> v2:172.21.15.171:3300/0 conn(0x7f647c0c2440 0x7f647c154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.454 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.446+0000 7f64831f0700 1 --2- 172.21.15.171:0/2964640582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c14eb10 0x7f647c05dc80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.454 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.446+0000 7f64831f0700 1 -- 172.21.15.171:0/2964640582 >> 172.21.15.171:0/2964640582 conn(0x7f647c0c3f20 msgr2=0x7f647c0c42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:12.454 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.446+0000 7f64831f0700 1 -- 172.21.15.171:0/2964640582 shutdown_connections 2022-03-21T13:54:12.454 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.446+0000 7f64831f0700 1 -- 172.21.15.171:0/2964640582 wait complete. 2022-03-21T13:54:12.455 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.448+0000 7f64831f0700 1 Processor -- start 2022-03-21T13:54:12.455 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.448+0000 7f64831f0700 1 -- start start 2022-03-21T13:54:12.457 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f64831f0700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0c2440 0x7f647c05d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.458 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f64831f0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c14eb10 0x7f647c166590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.458 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f64831f0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f647c14eee0 0x7f647c145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.458 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f64831f0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c153910 con 0x7f647c14eee0 2022-03-21T13:54:12.458 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f64831f0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c168730 con 0x7f647c14eb10 2022-03-21T13:54:12.459 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f64831f0700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c154450 con 0x7f647c0c2440 2022-03-21T13:54:12.459 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f6480f8c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0c2440 0x7f647c05d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.459 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f6480f8c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0c2440 0x7f647c05d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:52722/0 (socket says 172.21.15.171:52722) 2022-03-21T13:54:12.459 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f6480f8c700 1 -- 172.21.15.171:0/3384662541 learned_addr learned my addr 172.21.15.171:0/3384662541 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:12.459 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f647bfff700 1 --2- 172.21.15.171:0/3384662541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c14eb10 0x7f647c166590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.460 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f6480f8c700 1 -- 172.21.15.171:0/3384662541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c14eb10 msgr2=0x7f647c166590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.460 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f6480f8c700 1 --2- 172.21.15.171:0/3384662541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c14eb10 0x7f647c166590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.460 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f6480f8c700 1 -- 172.21.15.171:0/3384662541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f647c14eee0 msgr2=0x7f647c145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.460 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f6480f8c700 1 --2- 172.21.15.171:0/3384662541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f647c14eee0 0x7f647c145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.461 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.449+0000 7f6480f8c700 1 -- 172.21.15.171:0/3384662541 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474009ae0 con 0x7f647c0c2440 2022-03-21T13:54:12.461 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.450+0000 7f6480f8c700 1 --2- 172.21.15.171:0/3384662541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0c2440 0x7f647c05d5d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6470009e00 tx=0x7f6470017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:12.461 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.450+0000 7f6478ff9700 1 -- 172.21.15.171:0/3384662541 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470000bc0 con 0x7f647c0c2440 2022-03-21T13:54:12.461 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.450+0000 7f6478ff9700 1 -- 172.21.15.171:0/3384662541 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6470011900 con 0x7f647c0c2440 2022-03-21T13:54:12.461 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.450+0000 7f6478ff9700 1 -- 172.21.15.171:0/3384662541 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470025420 con 0x7f647c0c2440 2022-03-21T13:54:12.462 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.450+0000 7f64831f0700 1 -- 172.21.15.171:0/3384662541 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64700092a0 con 0x7f647c0c2440 2022-03-21T13:54:12.462 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.450+0000 7f64831f0700 1 -- 172.21.15.171:0/3384662541 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c168cb0 con 0x7f647c0c2440 2022-03-21T13:54:12.462 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.450+0000 7f6478ff9700 1 -- 172.21.15.171:0/3384662541 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f647002c030 con 0x7f647c0c2440 2022-03-21T13:54:12.462 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.450+0000 7f6478ff9700 1 -- 172.21.15.171:0/3384662541 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f647002fa40 con 0x7f647c0c2440 2022-03-21T13:54:12.463 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.451+0000 7f64831f0700 1 -- 172.21.15.171:0/3384662541 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c06fc00 con 0x7f647c0c2440 2022-03-21T13:54:12.463 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.453+0000 7f6478ff9700 1 -- 172.21.15.171:0/3384662541 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f6470034060 con 0x7f647c0c2440 2022-03-21T13:54:12.472 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:12.472+0000 7fca1df38000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-03-21T13:54:12.534 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.534+0000 7f64831f0700 1 -- 172.21.15.171:0/3384662541 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "24a9b956-5fa1-41bf-a689-0f048b7f19d8", "id": 6} v 0) v1 -- 0x7f647c149e00 con 0x7f647c0c2440 2022-03-21T13:54:12.539 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.538+0000 7f6478ff9700 1 -- 172.21.15.171:0/3384662541 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "24a9b956-5fa1-41bf-a689-0f048b7f19d8", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f647002a070 con 0x7f647c0c2440 2022-03-21T13:54:12.539 INFO:teuthology.orchestra.run.smithi171.stdout:6 2022-03-21T13:54:12.540 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.539+0000 7f64831f0700 1 -- 172.21.15.171:0/3384662541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0c2440 msgr2=0x7f647c05d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.541 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.539+0000 7f64831f0700 1 --2- 172.21.15.171:0/3384662541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0c2440 0x7f647c05d5d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6470009e00 tx=0x7f6470017000 comp rx=0 tx=0).stop 2022-03-21T13:54:12.541 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.539+0000 7f64831f0700 1 -- 172.21.15.171:0/3384662541 shutdown_connections 2022-03-21T13:54:12.541 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.539+0000 7f64831f0700 1 --2- 172.21.15.171:0/3384662541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f647c14eee0 0x7f647c145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.541 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.539+0000 7f64831f0700 1 --2- 172.21.15.171:0/3384662541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0c2440 0x7f647c05d5d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.542 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.539+0000 7f64831f0700 1 --2- 172.21.15.171:0/3384662541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c14eb10 0x7f647c166590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.542 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.539+0000 7f64831f0700 1 -- 172.21.15.171:0/3384662541 >> 172.21.15.171:0/3384662541 conn(0x7f647c0c3f20 msgr2=0x7f647c068b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:12.542 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.539+0000 7f64831f0700 1 -- 172.21.15.171:0/3384662541 shutdown_connections 2022-03-21T13:54:12.542 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.539+0000 7f64831f0700 1 -- 172.21.15.171:0/3384662541 wait complete. 2022-03-21T13:54:12.553 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new a5ab4a14-8a7b-43b8-932c-a950f81c10f4 7 2022-03-21T13:54:12.629 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:12.629+0000 7fca1df38000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-03-21T13:54:12.668 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.667+0000 7fd971e6a700 1 Processor -- start 2022-03-21T13:54:12.669 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.667+0000 7fd971e6a700 1 -- start start 2022-03-21T13:54:12.673 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.668+0000 7fd971e6a700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd96c0c7400 0x7fd96c06a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.674 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.668+0000 7fd971e6a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd96c06ac60 0x7fd96c0c4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.674 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.668+0000 7fd971e6a700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c0c4ec0 con 0x7fd96c158350 2022-03-21T13:54:12.674 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.668+0000 7fd971e6a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c0c5a10 con 0x7fd96c06ac60 2022-03-21T13:54:12.674 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.668+0000 7fd971e6a700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c0c53d0 con 0x7fd96c0c7400 2022-03-21T13:54:12.674 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.668+0000 7fd962ffd700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd96c0c7400 0x7fd96c06a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.675 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.668+0000 7fd96b7fe700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fd96c158350 0x7fd96c158720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52364/0 (socket says 172.21.15.171:52364) 2022-03-21T13:54:12.675 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.668+0000 7fd96b7fe700 1 -- 172.21.15.171:0/910570531 learned_addr learned my addr 172.21.15.171:0/910570531 (peer_addr_for_me v1:172.21.15.171:0/0) 2022-03-21T13:54:12.675 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.668+0000 7fd96bfff700 1 --2- 172.21.15.171:0/910570531 >> v2:172.21.15.160:3300/0 conn(0x7fd96c06ac60 0x7fd96c0c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.675 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd962ffd700 1 -- 172.21.15.171:0/910570531 >> v2:172.21.15.160:3300/0 conn(0x7fd96c06ac60 msgr2=0x7fd96c0c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:12.676 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd962ffd700 1 --2- 172.21.15.171:0/910570531 >> v2:172.21.15.160:3300/0 conn(0x7fd96c06ac60 0x7fd96c0c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.676 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd962ffd700 1 -- 172.21.15.171:0/910570531 >> v1:172.21.15.171:6789/0 conn(0x7fd96c158350 legacy=0x7fd96c158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.676 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd962ffd700 1 -- 172.21.15.171:0/910570531 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c06a290 con 0x7fd96c0c7400 2022-03-21T13:54:12.676 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd96affd700 1 -- 172.21.15.171:0/910570531 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420435641 0 0) 0x7fd96c0c4ec0 con 0x7fd96c158350 2022-03-21T13:54:12.676 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd962ffd700 1 --2- 172.21.15.171:0/910570531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd96c0c7400 0x7fd96c06a720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0672b0 tx=0x7fd954009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7091769df9c0df62 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:12.677 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd96affd700 1 -- 172.21.15.171:0/910570531 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954011630 con 0x7fd96c0c7400 2022-03-21T13:54:12.677 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd96affd700 1 -- 172.21.15.171:0/910570531 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd954011790 con 0x7fd96c0c7400 2022-03-21T13:54:12.677 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd96affd700 1 -- 172.21.15.171:0/910570531 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954011b30 con 0x7fd96c0c7400 2022-03-21T13:54:12.677 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd971e6a700 1 -- 172.21.15.171:0/910570531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd96c0c7400 msgr2=0x7fd96c06a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.678 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd971e6a700 1 --2- 172.21.15.171:0/910570531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd96c0c7400 0x7fd96c06a720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0672b0 tx=0x7fd954009060 comp rx=0 tx=0).stop 2022-03-21T13:54:12.678 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd971e6a700 1 -- 172.21.15.171:0/910570531 shutdown_connections 2022-03-21T13:54:12.678 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd971e6a700 1 --2- 172.21.15.171:0/910570531 >> v2:172.21.15.160:3300/0 conn(0x7fd96c06ac60 0x7fd96c0c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.678 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd971e6a700 1 --2- 172.21.15.171:0/910570531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd96c0c7400 0x7fd96c06a720 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.679 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd971e6a700 1 -- 172.21.15.171:0/910570531 >> 172.21.15.171:0/910570531 conn(0x7fd96c0cb000 msgr2=0x7fd96c0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:12.679 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd971e6a700 1 -- 172.21.15.171:0/910570531 shutdown_connections 2022-03-21T13:54:12.679 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.669+0000 7fd971e6a700 1 -- 172.21.15.171:0/910570531 wait complete. 2022-03-21T13:54:12.679 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.670+0000 7fd971e6a700 1 Processor -- start 2022-03-21T13:54:12.679 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.671+0000 7fd971e6a700 1 -- start start 2022-03-21T13:54:12.680 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.671+0000 7fd971e6a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd96c06ac60 0x7fd96c150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.680 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.671+0000 7fd971e6a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd96c0c7400 0x7fd96c15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.680 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.671+0000 7fd971e6a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd96c158350 0x7fd96c157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.680 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.671+0000 7fd971e6a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c168400 con 0x7fd96c0c7400 2022-03-21T13:54:12.680 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.671+0000 7fd971e6a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c1693d0 con 0x7fd96c06ac60 2022-03-21T13:54:12.681 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.671+0000 7fd971e6a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c168f40 con 0x7fd96c158350 2022-03-21T13:54:12.681 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.671+0000 7fd96b7fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd96c06ac60 0x7fd96c150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.681 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd96bfff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd96c158350 0x7fd96c157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.681 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd96b7fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd96c06ac60 0x7fd96c150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:46900/0 (socket says 172.21.15.171:46900) 2022-03-21T13:54:12.682 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd96b7fe700 1 -- 172.21.15.171:0/3558615753 learned_addr learned my addr 172.21.15.171:0/3558615753 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-03-21T13:54:12.682 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd962ffd700 1 --2- 172.21.15.171:0/3558615753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd96c0c7400 0x7fd96c15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.682 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd96bfff700 1 -- 172.21.15.171:0/3558615753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd96c06ac60 msgr2=0x7fd96c150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.682 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd96bfff700 1 --2- 172.21.15.171:0/3558615753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd96c06ac60 0x7fd96c150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.682 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd96bfff700 1 -- 172.21.15.171:0/3558615753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd96c0c7400 msgr2=0x7fd96c15bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.683 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd96bfff700 1 --2- 172.21.15.171:0/3558615753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd96c0c7400 0x7fd96c15bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.683 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd96bfff700 1 -- 172.21.15.171:0/3558615753 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9540092a0 con 0x7fd96c158350 2022-03-21T13:54:12.683 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd96b7fe700 1 --2- 172.21.15.171:0/3558615753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd96c06ac60 0x7fd96c150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:12.683 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd96bfff700 1 --2- 172.21.15.171:0/3558615753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd96c158350 0x7fd96c157060 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd964009e50 tx=0x7fd96400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:12.684 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd963fff700 1 -- 172.21.15.171:0/3558615753 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96400cad0 con 0x7fd96c158350 2022-03-21T13:54:12.684 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd963fff700 1 -- 172.21.15.171:0/3558615753 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96400f040 con 0x7fd96c158350 2022-03-21T13:54:12.684 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd963fff700 1 -- 172.21.15.171:0/3558615753 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96400ce80 con 0x7fd96c158350 2022-03-21T13:54:12.684 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd971e6a700 1 -- 172.21.15.171:0/3558615753 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c14fa70 con 0x7fd96c158350 2022-03-21T13:54:12.684 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.672+0000 7fd971e6a700 1 -- 172.21.15.171:0/3558615753 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c14fd10 con 0x7fd96c158350 2022-03-21T13:54:12.685 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:12.676+0000 7f7efbfd2000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-03-21T13:54:12.686 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.673+0000 7fd963fff700 1 -- 172.21.15.171:0/3558615753 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fd964024070 con 0x7fd96c158350 2022-03-21T13:54:12.686 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.673+0000 7fd971e6a700 1 -- 172.21.15.171:0/3558615753 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c070ae0 con 0x7fd96c158350 2022-03-21T13:54:12.686 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.673+0000 7fd963fff700 1 -- 172.21.15.171:0/3558615753 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fd96401dbb0 con 0x7fd96c158350 2022-03-21T13:54:12.687 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.677+0000 7fd963fff700 1 -- 172.21.15.171:0/3558615753 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7fd96403c470 con 0x7fd96c158350 2022-03-21T13:54:12.759 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.758+0000 7fd971e6a700 1 -- 172.21.15.171:0/3558615753 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a5ab4a14-8a7b-43b8-932c-a950f81c10f4", "id": 7} v 0) v1 -- 0x7fd96c169080 con 0x7fd96c158350 2022-03-21T13:54:12.763 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.763+0000 7fd963fff700 1 -- 172.21.15.171:0/3558615753 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a5ab4a14-8a7b-43b8-932c-a950f81c10f4", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd96402b070 con 0x7fd96c158350 2022-03-21T13:54:12.764 INFO:teuthology.orchestra.run.smithi171.stdout:7 2022-03-21T13:54:12.766 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.764+0000 7fd971e6a700 1 -- 172.21.15.171:0/3558615753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd96c158350 msgr2=0x7fd96c157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.766 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.764+0000 7fd971e6a700 1 --2- 172.21.15.171:0/3558615753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd96c158350 0x7fd96c157060 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd964009e50 tx=0x7fd96400b040 comp rx=0 tx=0).stop 2022-03-21T13:54:12.766 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.764+0000 7fd971e6a700 1 -- 172.21.15.171:0/3558615753 shutdown_connections 2022-03-21T13:54:12.767 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.764+0000 7fd971e6a700 1 --2- 172.21.15.171:0/3558615753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd96c158350 0x7fd96c157060 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.767 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.764+0000 7fd971e6a700 1 --2- 172.21.15.171:0/3558615753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd96c06ac60 0x7fd96c150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.767 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.764+0000 7fd971e6a700 1 --2- 172.21.15.171:0/3558615753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd96c0c7400 0x7fd96c15bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.767 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.764+0000 7fd971e6a700 1 -- 172.21.15.171:0/3558615753 >> 172.21.15.171:0/3558615753 conn(0x7fd96c0cb000 msgr2=0x7fd96c0c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:12.767 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.764+0000 7fd971e6a700 1 -- 172.21.15.171:0/3558615753 shutdown_connections 2022-03-21T13:54:12.768 INFO:teuthology.orchestra.run.smithi171.stderr:2022-03-21T13:54:12.764+0000 7fd971e6a700 1 -- 172.21.15.171:0/3558615753 wait complete. 2022-03-21T13:54:12.776 INFO:tasks.ceph.osd.0:Restarting daemon 2022-03-21T13:54:12.776 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-03-21T13:54:12.779 INFO:tasks.ceph.osd.0:Started 2022-03-21T13:54:12.779 INFO:tasks.ceph.osd.1:Restarting daemon 2022-03-21T13:54:12.779 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-03-21T13:54:12.781 INFO:tasks.ceph.osd.1:Started 2022-03-21T13:54:12.782 INFO:tasks.ceph.osd.2:Restarting daemon 2022-03-21T13:54:12.782 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-03-21T13:54:12.784 INFO:tasks.ceph.osd.2:Started 2022-03-21T13:54:12.785 INFO:tasks.ceph.osd.3:Restarting daemon 2022-03-21T13:54:12.785 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-03-21T13:54:12.787 INFO:tasks.ceph.osd.3:Started 2022-03-21T13:54:12.787 INFO:tasks.ceph.osd.4:Restarting daemon 2022-03-21T13:54:12.788 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-03-21T13:54:12.790 INFO:tasks.ceph.osd.4:Started 2022-03-21T13:54:12.791 INFO:tasks.ceph.osd.5:Restarting daemon 2022-03-21T13:54:12.791 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-03-21T13:54:12.793 INFO:tasks.ceph.osd.5:Started 2022-03-21T13:54:12.794 INFO:tasks.ceph.osd.6:Restarting daemon 2022-03-21T13:54:12.794 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-03-21T13:54:12.796 INFO:tasks.ceph.osd.6:Started 2022-03-21T13:54:12.797 INFO:tasks.ceph.osd.7:Restarting daemon 2022-03-21T13:54:12.797 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-03-21T13:54:12.799 INFO:tasks.ceph.osd.7:Started 2022-03-21T13:54:12.800 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-21T13:54:12.839 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:12.837+0000 7f7efbfd2000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-03-21T13:54:12.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.932+0000 7f294935f700 1 Processor -- start 2022-03-21T13:54:12.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.932+0000 7f294935f700 1 -- start start 2022-03-21T13:54:12.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f294935f700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f29440c4430 0x7f2944155460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f294935f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f29440c9e90 0x7f29440c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f294935f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29440c5290 con 0x7f29440c6b50 2022-03-21T13:54:12.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f294935f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29440c2660 con 0x7f29440c9e90 2022-03-21T13:54:12.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f294935f700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29440c6180 con 0x7f29440c4430 2022-03-21T13:54:12.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f29427fc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f29440c9e90 0x7f29440c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f29437fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f29440c6b50 0x7f29440c8ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:58832/0 (socket says 172.21.15.160:58832) 2022-03-21T13:54:12.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f29437fe700 1 -- 172.21.15.160:0/3736447440 learned_addr learned my addr 172.21.15.160:0/3736447440 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:12.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f2942ffd700 1 --2- 172.21.15.160:0/3736447440 >> v2:172.21.15.171:3300/0 conn(0x7f29440c4430 0x7f2944155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f29427fc700 1 -- 172.21.15.160:0/3736447440 >> v2:172.21.15.171:3300/0 conn(0x7f29440c4430 msgr2=0x7f2944155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:12.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f29427fc700 1 --2- 172.21.15.160:0/3736447440 >> v2:172.21.15.171:3300/0 conn(0x7f29440c4430 0x7f2944155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f29427fc700 1 -- 172.21.15.160:0/3736447440 >> v1:172.21.15.160:6789/0 conn(0x7f29440c6b50 legacy=0x7f29440c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f2941ffb700 1 -- 172.21.15.160:0/3736447440 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664838234 0 0) 0x7f29440c5290 con 0x7f29440c6b50 2022-03-21T13:54:12.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f29427fc700 1 -- 172.21.15.160:0/3736447440 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440c4cf0 con 0x7f29440c9e90 2022-03-21T13:54:12.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.933+0000 7f29427fc700 1 --2- 172.21.15.160:0/3736447440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29440c9e90 0x7f29440c6610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2944067540 tx=0x7f2934009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4684d319da6c60cd server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:12.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.934+0000 7f2941ffb700 1 -- 172.21.15.160:0/3736447440 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934011630 con 0x7f29440c9e90 2022-03-21T13:54:12.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.934+0000 7f2941ffb700 1 -- 172.21.15.160:0/3736447440 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934011790 con 0x7f29440c9e90 2022-03-21T13:54:12.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.934+0000 7f2941ffb700 1 -- 172.21.15.160:0/3736447440 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934011b30 con 0x7f29440c9e90 2022-03-21T13:54:12.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.934+0000 7f294935f700 1 -- 172.21.15.160:0/3736447440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29440c9e90 msgr2=0x7f29440c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.934+0000 7f294935f700 1 --2- 172.21.15.160:0/3736447440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29440c9e90 0x7f29440c6610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2944067540 tx=0x7f2934009060 comp rx=0 tx=0).stop 2022-03-21T13:54:12.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.934+0000 7f294935f700 1 -- 172.21.15.160:0/3736447440 shutdown_connections 2022-03-21T13:54:12.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.934+0000 7f294935f700 1 --2- 172.21.15.160:0/3736447440 >> v2:172.21.15.171:3300/0 conn(0x7f29440c4430 0x7f2944155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.934+0000 7f294935f700 1 --2- 172.21.15.160:0/3736447440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29440c9e90 0x7f29440c6610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.934+0000 7f294935f700 1 -- 172.21.15.160:0/3736447440 >> 172.21.15.160:0/3736447440 conn(0x7f29440cb940 msgr2=0x7f29440c7910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:12.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.934+0000 7f294935f700 1 -- 172.21.15.160:0/3736447440 shutdown_connections 2022-03-21T13:54:12.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.934+0000 7f294935f700 1 -- 172.21.15.160:0/3736447440 wait complete. 2022-03-21T13:54:12.943 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.935+0000 7f294935f700 1 Processor -- start 2022-03-21T13:54:12.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.935+0000 7f294935f700 1 -- start start 2022-03-21T13:54:12.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.936+0000 7f294935f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29440c4430 0x7f294406b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.936+0000 7f294935f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29440c6b50 0x7f29440c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.936+0000 7f294935f700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29440c9e90 0x7f2944153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:12.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.936+0000 7f294935f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2944156f40 con 0x7f29440c4430 2022-03-21T13:54:12.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.936+0000 7f294935f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2944148850 con 0x7f29440c6b50 2022-03-21T13:54:12.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.936+0000 7f294935f700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2944164ba0 con 0x7f29440c9e90 2022-03-21T13:54:12.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.936+0000 7f2942ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29440c4430 0x7f294406b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.936+0000 7f2942ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29440c4430 0x7f294406b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:55684/0 (socket says 172.21.15.160:55684) 2022-03-21T13:54:12.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.936+0000 7f2942ffd700 1 -- 172.21.15.160:0/3171339069 learned_addr learned my addr 172.21.15.160:0/3171339069 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:12.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.936+0000 7f29427fc700 1 --2- 172.21.15.160:0/3171339069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29440c6b50 0x7f29440c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.936+0000 7f29437fe700 1 --2- 172.21.15.160:0/3171339069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29440c9e90 0x7f2944153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:12.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f2942ffd700 1 -- 172.21.15.160:0/3171339069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29440c9e90 msgr2=0x7f2944153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f2942ffd700 1 --2- 172.21.15.160:0/3171339069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29440c9e90 0x7f2944153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f2942ffd700 1 -- 172.21.15.160:0/3171339069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29440c6b50 msgr2=0x7f29440c1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:12.947 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f2942ffd700 1 --2- 172.21.15.160:0/3171339069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29440c6b50 0x7f29440c1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:12.947 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f2942ffd700 1 -- 172.21.15.160:0/3171339069 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340092a0 con 0x7f29440c4430 2022-03-21T13:54:12.947 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f2942ffd700 1 --2- 172.21.15.160:0/3171339069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29440c4430 0x7f294406b6d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f293800e930 tx=0x7f2938009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:12.947 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f292affd700 1 -- 172.21.15.160:0/3171339069 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938013680 con 0x7f29440c4430 2022-03-21T13:54:12.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f292affd700 1 -- 172.21.15.160:0/3171339069 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29380137e0 con 0x7f29440c4430 2022-03-21T13:54:12.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f292affd700 1 -- 172.21.15.160:0/3171339069 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938013b60 con 0x7f29440c4430 2022-03-21T13:54:12.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f294935f700 1 -- 172.21.15.160:0/3171339069 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2944164e80 con 0x7f29440c4430 2022-03-21T13:54:12.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f294935f700 1 -- 172.21.15.160:0/3171339069 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2944165440 con 0x7f29440c4430 2022-03-21T13:54:12.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f292affd700 1 -- 172.21.15.160:0/3171339069 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f2938019030 con 0x7f29440c4430 2022-03-21T13:54:12.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.937+0000 7f292affd700 1 -- 172.21.15.160:0/3171339069 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f2938005b00 con 0x7f29440c4430 2022-03-21T13:54:12.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.938+0000 7f294935f700 1 -- 172.21.15.160:0/3171339069 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294404b760 con 0x7f29440c4430 2022-03-21T13:54:12.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:12.942+0000 7f292affd700 1 -- 172.21.15.160:0/3171339069 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f2938021060 con 0x7f29440c4430 2022-03-21T13:54:13.009 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:13.009+0000 7f294935f700 1 -- 172.21.15.160:0/3171339069 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f294406a6e0 con 0x7f29440c4430 2022-03-21T13:54:13.010 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:13.010+0000 7f292affd700 1 -- 172.21.15.160:0/3171339069 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6992 (secure 0 0 0) 0x7f2938029020 con 0x7f29440c4430 2022-03-21T13:54:13.011 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:13.011 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":10,"fsid":"b2a3ddc8-064e-4cc9-8187-33ea19afd50a","created":"2022-03-21T13:54:10.384226+0000","modified":"2022-03-21T13:54:12.760084+0000","last_up_change":"0.000000","last_in_change":"2022-03-21T13:54:12.760084+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"828ac39d-86ad-44a1-bb66-c99786642970","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"464764e2-a47e-43c0-8c93-b6bfd10ba526","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4dbfea57-14b6-4c67-8312-fc7d71ef77a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c53ed58d-a1f3-4783-8677-9348a1d103f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5713dbd4-1736-4ebf-8102-e80f4db6bcc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dfe21128-6ae6-4662-9f47-1bbb423a2232","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"24a9b956-5fa1-41bf-a689-0f048b7f19d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a5ab4a14-8a7b-43b8-932c-a950f81c10f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-21T13:54:13.012 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:13.011+0000 7f294935f700 1 -- 172.21.15.160:0/3171339069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29440c4430 msgr2=0x7f294406b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:13.012 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:13.011+0000 7f294935f700 1 --2- 172.21.15.160:0/3171339069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29440c4430 0x7f294406b6d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f293800e930 tx=0x7f2938009060 comp rx=0 tx=0).stop 2022-03-21T13:54:13.013 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:13.011+0000 7f294935f700 1 -- 172.21.15.160:0/3171339069 shutdown_connections 2022-03-21T13:54:13.013 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:13.011+0000 7f294935f700 1 --2- 172.21.15.160:0/3171339069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29440c9e90 0x7f2944153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:13.013 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:13.011+0000 7f294935f700 1 --2- 172.21.15.160:0/3171339069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29440c4430 0x7f294406b6d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:13.013 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:13.011+0000 7f294935f700 1 --2- 172.21.15.160:0/3171339069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29440c6b50 0x7f29440c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:13.013 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:13.011+0000 7f294935f700 1 -- 172.21.15.160:0/3171339069 >> 172.21.15.160:0/3171339069 conn(0x7f29440cb940 msgr2=0x7f2944151ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:13.014 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:13.011+0000 7f294935f700 1 -- 172.21.15.160:0/3171339069 shutdown_connections 2022-03-21T13:54:13.014 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:13.011+0000 7f294935f700 1 -- 172.21.15.160:0/3171339069 wait complete. 2022-03-21T13:54:13.023 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-03-21T13:54:13.024 INFO:tasks.ceph:Waiting for OSDs to come up 2022-03-21T13:54:13.127 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:13.127+0000 7fca1df38000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-03-21T13:54:13.267 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:13.267+0000 7fca1df38000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-03-21T13:54:13.389 INFO:tasks.ceph.osd.3.smithi160.stderr:2022-03-21T13:54:13.388+0000 7f43842303c0 -1 Falling back to public interface 2022-03-21T13:54:13.393 INFO:tasks.ceph.osd.5.smithi171.stderr:2022-03-21T13:54:13.392+0000 7f0bd98903c0 -1 Falling back to public interface 2022-03-21T13:54:13.396 INFO:tasks.ceph.osd.0.smithi160.stderr:2022-03-21T13:54:13.395+0000 7f916296e3c0 -1 Falling back to public interface 2022-03-21T13:54:13.396 INFO:tasks.ceph.osd.2.smithi160.stderr:2022-03-21T13:54:13.395+0000 7f06296663c0 -1 Falling back to public interface 2022-03-21T13:54:13.403 INFO:tasks.ceph.osd.7.smithi171.stderr:2022-03-21T13:54:13.402+0000 7faee6b853c0 -1 Falling back to public interface 2022-03-21T13:54:13.405 INFO:tasks.ceph.osd.4.smithi171.stderr:2022-03-21T13:54:13.405+0000 7fe2fb3cf3c0 -1 Falling back to public interface 2022-03-21T13:54:13.407 INFO:tasks.ceph.osd.6.smithi171.stderr:2022-03-21T13:54:13.407+0000 7fce0b81f3c0 -1 Falling back to public interface 2022-03-21T13:54:13.410 INFO:tasks.ceph.osd.1.smithi160.stderr:2022-03-21T13:54:13.409+0000 7f96d88d53c0 -1 Falling back to public interface 2022-03-21T13:54:13.497 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:13.496+0000 7f7efbfd2000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-03-21T13:54:13.567 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:13.567+0000 7f7efbfd2000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-03-21T13:54:13.643 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:13.642+0000 7f7efbfd2000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-03-21T13:54:13.830 DEBUG:teuthology.orchestra.run.smithi160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-03-21T13:54:13.899 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:13.898+0000 7fca1df38000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-03-21T13:54:13.939 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.939+0000 7f1afbe23700 1 Processor -- start 2022-03-21T13:54:13.940 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.939+0000 7f1afbe23700 1 -- start start 2022-03-21T13:54:13.942 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afbe23700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af414f1b0 0x7f1af406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:13.943 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afbe23700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1af40669f0 0x7f1af4154c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:13.943 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afbe23700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af4068530 con 0x7f1af414ede0 2022-03-21T13:54:13.943 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afbe23700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af40c3db0 con 0x7f1af40669f0 2022-03-21T13:54:13.943 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afbe23700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40689c0 con 0x7f1af414f1b0 2022-03-21T13:54:13.944 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1af93be700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af414f1b0 0x7f1af406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:13.944 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afa3c0700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1af40669f0 0x7f1af4154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:13.944 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afa3c0700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1af40669f0 0x7f1af4154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:58632/0 (socket says 172.21.15.160:58632) 2022-03-21T13:54:13.944 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1af93be700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af414f1b0 0x7f1af406cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:46088/0 (socket says 172.21.15.160:46088) 2022-03-21T13:54:13.944 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afa3c0700 1 -- 172.21.15.160:0/2561017927 learned_addr learned my addr 172.21.15.160:0/2561017927 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:13.945 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afa3c0700 1 -- 172.21.15.160:0/2561017927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af414f1b0 msgr2=0x7f1af406cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:13.945 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afa3c0700 1 --2- 172.21.15.160:0/2561017927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af414f1b0 0x7f1af406cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:13.945 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afa3c0700 1 -- 172.21.15.160:0/2561017927 >> v1:172.21.15.171:6789/0 conn(0x7f1af414ede0 legacy=0x7f1af40c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:13.945 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afa3c0700 1 -- 172.21.15.160:0/2561017927 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af4067920 con 0x7f1af40669f0 2022-03-21T13:54:13.945 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1af93be700 1 --2- 172.21.15.160:0/2561017927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af414f1b0 0x7f1af406cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:13.946 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.940+0000 7f1afa3c0700 1 --2- 172.21.15.160:0/2561017927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af40669f0 0x7f1af4154c20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009f20 tx=0x7f1aec009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae2ea953ba256c7e server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:13.946 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.941+0000 7f1af8bbd700 1 -- 172.21.15.160:0/2561017927 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00e070 con 0x7f1af40669f0 2022-03-21T13:54:13.946 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.941+0000 7f1af8bbd700 1 -- 172.21.15.160:0/2561017927 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec00ba60 con 0x7f1af40669f0 2022-03-21T13:54:13.946 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.941+0000 7f1af8bbd700 1 -- 172.21.15.160:0/2561017927 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0092e0 con 0x7f1af40669f0 2022-03-21T13:54:13.947 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.941+0000 7f1afbe23700 1 -- 172.21.15.160:0/2561017927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af40669f0 msgr2=0x7f1af4154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:13.947 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.941+0000 7f1afbe23700 1 --2- 172.21.15.160:0/2561017927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af40669f0 0x7f1af4154c20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009f20 tx=0x7f1aec009840 comp rx=0 tx=0).stop 2022-03-21T13:54:13.947 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.941+0000 7f1afbe23700 1 -- 172.21.15.160:0/2561017927 shutdown_connections 2022-03-21T13:54:13.947 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.941+0000 7f1afbe23700 1 --2- 172.21.15.160:0/2561017927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af40669f0 0x7f1af4154c20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:13.948 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.941+0000 7f1afbe23700 1 --2- 172.21.15.160:0/2561017927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af414f1b0 0x7f1af406cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:13.948 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.941+0000 7f1afbe23700 1 -- 172.21.15.160:0/2561017927 >> 172.21.15.160:0/2561017927 conn(0x7f1af40c98b0 msgr2=0x7f1af40c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:13.948 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.942+0000 7f1afbe23700 1 -- 172.21.15.160:0/2561017927 shutdown_connections 2022-03-21T13:54:13.948 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.942+0000 7f1afbe23700 1 -- 172.21.15.160:0/2561017927 wait complete. 2022-03-21T13:54:13.951 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.943+0000 7f1afbe23700 1 Processor -- start 2022-03-21T13:54:13.952 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.943+0000 7f1afbe23700 1 -- start start 2022-03-21T13:54:13.952 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.943+0000 7f1afbe23700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af40669f0 0x7f1af41661d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:13.952 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.943+0000 7f1afbe23700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af414ede0 0x7f1af41593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:13.952 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.943+0000 7f1afbe23700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1af414f1b0 0x7f1af414bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:13.953 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.943+0000 7f1afbe23700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af414fa20 con 0x7f1af414f1b0 2022-03-21T13:54:13.953 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.943+0000 7f1afbe23700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af414fd00 con 0x7f1af414ede0 2022-03-21T13:54:13.953 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.943+0000 7f1afbe23700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4164e90 con 0x7f1af40669f0 2022-03-21T13:54:13.953 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.943+0000 7f1afa3c0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1af414f1b0 0x7f1af414bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:13.954 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1afa3c0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1af414f1b0 0x7f1af414bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:55700/0 (socket says 172.21.15.160:55700) 2022-03-21T13:54:13.954 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1afa3c0700 1 -- 172.21.15.160:0/1312703331 learned_addr learned my addr 172.21.15.160:0/1312703331 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:13.954 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1af93be700 1 --2- 172.21.15.160:0/1312703331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af414ede0 0x7f1af41593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:13.954 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1af9bbf700 1 --2- 172.21.15.160:0/1312703331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af40669f0 0x7f1af41661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:13.954 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1afa3c0700 1 -- 172.21.15.160:0/1312703331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af40669f0 msgr2=0x7f1af41661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:13.955 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1afa3c0700 1 --2- 172.21.15.160:0/1312703331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af40669f0 0x7f1af41661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:13.955 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1afa3c0700 1 -- 172.21.15.160:0/1312703331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af414ede0 msgr2=0x7f1af41593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:13.955 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1afa3c0700 1 --2- 172.21.15.160:0/1312703331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af414ede0 0x7f1af41593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:13.955 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1afa3c0700 1 -- 172.21.15.160:0/1312703331 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae40092a0 con 0x7f1af414f1b0 2022-03-21T13:54:13.956 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1af9bbf700 1 --2- 172.21.15.160:0/1312703331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af40669f0 0x7f1af41661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:13.956 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1af93be700 1 --2- 172.21.15.160:0/1312703331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af414ede0 0x7f1af41593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:13.956 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1afa3c0700 1 --2- 172.21.15.160:0/1312703331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1af414f1b0 0x7f1af414bfc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009880 tx=0x7f1aec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:13.956 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1ae1ffb700 1 -- 172.21.15.160:0/1312703331 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0094e0 con 0x7f1af414f1b0 2022-03-21T13:54:13.956 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1ae1ffb700 1 -- 172.21.15.160:0/1312703331 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec007610 con 0x7f1af414f1b0 2022-03-21T13:54:13.957 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1afbe23700 1 -- 172.21.15.160:0/1312703331 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec009ae0 con 0x7f1af414f1b0 2022-03-21T13:54:13.957 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1ae1ffb700 1 -- 172.21.15.160:0/1312703331 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0079d0 con 0x7f1af414f1b0 2022-03-21T13:54:13.957 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.944+0000 7f1afbe23700 1 -- 172.21.15.160:0/1312703331 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af4165450 con 0x7f1af414f1b0 2022-03-21T13:54:13.957 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.945+0000 7f1ae1ffb700 1 -- 172.21.15.160:0/1312703331 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f1aec004040 con 0x7f1af414f1b0 2022-03-21T13:54:13.958 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.945+0000 7f1ae1ffb700 1 -- 172.21.15.160:0/1312703331 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f1aec007e00 con 0x7f1af414f1b0 2022-03-21T13:54:13.958 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.946+0000 7f1afbe23700 1 -- 172.21.15.160:0/1312703331 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af406ffa0 con 0x7f1af414f1b0 2022-03-21T13:54:13.958 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:13.948+0000 7f1ae1ffb700 1 -- 172.21.15.160:0/1312703331 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f1aec02a020 con 0x7f1af414f1b0 2022-03-21T13:54:13.971 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:13.970+0000 7fca1df38000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-03-21T13:54:14.015 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:14.015+0000 7f1afbe23700 1 -- 172.21.15.160:0/1312703331 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1af4158fd0 con 0x7f1af414f1b0 2022-03-21T13:54:14.016 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:14.015+0000 7f1ae1ffb700 1 -- 172.21.15.160:0/1312703331 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6992 (secure 0 0 0) 0x7f1aec035090 con 0x7f1af414f1b0 2022-03-21T13:54:14.016 INFO:teuthology.misc.health.smithi160.stdout: 2022-03-21T13:54:14.016 INFO:teuthology.misc.health.smithi160.stdout:{"epoch":10,"fsid":"b2a3ddc8-064e-4cc9-8187-33ea19afd50a","created":"2022-03-21T13:54:10.384226+0000","modified":"2022-03-21T13:54:12.760084+0000","last_up_change":"0.000000","last_in_change":"2022-03-21T13:54:12.760084+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"828ac39d-86ad-44a1-bb66-c99786642970","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"464764e2-a47e-43c0-8c93-b6bfd10ba526","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4dbfea57-14b6-4c67-8312-fc7d71ef77a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c53ed58d-a1f3-4783-8677-9348a1d103f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5713dbd4-1736-4ebf-8102-e80f4db6bcc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dfe21128-6ae6-4662-9f47-1bbb423a2232","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"24a9b956-5fa1-41bf-a689-0f048b7f19d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a5ab4a14-8a7b-43b8-932c-a950f81c10f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-21T13:54:14.018 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:14.016+0000 7f1afbe23700 1 -- 172.21.15.160:0/1312703331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1af414f1b0 msgr2=0x7f1af414bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:14.018 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:14.016+0000 7f1afbe23700 1 --2- 172.21.15.160:0/1312703331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1af414f1b0 0x7f1af414bfc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009880 tx=0x7f1aec018000 comp rx=0 tx=0).stop 2022-03-21T13:54:14.018 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:14.016+0000 7f1afbe23700 1 -- 172.21.15.160:0/1312703331 shutdown_connections 2022-03-21T13:54:14.018 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:14.016+0000 7f1afbe23700 1 --2- 172.21.15.160:0/1312703331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1af414f1b0 0x7f1af414bfc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:14.019 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:14.016+0000 7f1afbe23700 1 --2- 172.21.15.160:0/1312703331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1af40669f0 0x7f1af41661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:14.019 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:14.016+0000 7f1afbe23700 1 --2- 172.21.15.160:0/1312703331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af414ede0 0x7f1af41593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:14.019 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:14.016+0000 7f1afbe23700 1 -- 172.21.15.160:0/1312703331 >> 172.21.15.160:0/1312703331 conn(0x7f1af40c98b0 msgr2=0x7f1af414e280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:14.019 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:14.016+0000 7f1afbe23700 1 -- 172.21.15.160:0/1312703331 shutdown_connections 2022-03-21T13:54:14.020 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:14.016+0000 7f1afbe23700 1 -- 172.21.15.160:0/1312703331 wait complete. 2022-03-21T13:54:14.027 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-03-21T13:54:14.047 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:14.047+0000 7fca1df38000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-03-21T13:54:14.103 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:14.103+0000 7f7efbfd2000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-03-21T13:54:14.182 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:14.182+0000 7f7efbfd2000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-03-21T13:54:14.264 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:14.264+0000 7f7efbfd2000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-03-21T13:54:14.450 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:14.449+0000 7f7efbfd2000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-03-21T13:54:14.503 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:14.502+0000 7fca1df38000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-03-21T13:54:14.526 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:14.525+0000 7f7efbfd2000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-03-21T13:54:14.583 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:14.582+0000 7fca1df38000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-03-21T13:54:14.638 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:14.637+0000 7f7efbfd2000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-03-21T13:54:14.661 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:14.661+0000 7fca1df38000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-03-21T13:54:14.850 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:14.849+0000 7fca1df38000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-03-21T13:54:14.924 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:14.923+0000 7fca1df38000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-03-21T13:54:15.021 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:15.020+0000 7fca1df38000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-03-21T13:54:15.360 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:15.359+0000 7f7efbfd2000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-03-21T13:54:15.437 INFO:tasks.ceph.mgr.y.smithi160.stderr:2022-03-21T13:54:15.437+0000 7f7efbfd2000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-03-21T13:54:15.746 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:15.745+0000 7fca1df38000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-03-21T13:54:15.822 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-03-21T13:54:15.822+0000 7fca1df38000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-03-21T13:54:16.893 INFO:tasks.ceph.osd.5.smithi171.stderr:2022-03-21T13:54:16.893+0000 7f0bd98903c0 -1 osd.5 0 log_to_monitors true 2022-03-21T13:54:16.895 INFO:tasks.ceph.osd.3.smithi160.stderr:2022-03-21T13:54:16.895+0000 7f43842303c0 -1 osd.3 0 log_to_monitors true 2022-03-21T13:54:16.909 INFO:tasks.ceph.osd.0.smithi160.stderr:2022-03-21T13:54:16.909+0000 7f916296e3c0 -1 osd.0 0 log_to_monitors true 2022-03-21T13:54:16.932 INFO:tasks.ceph.osd.7.smithi171.stderr:2022-03-21T13:54:16.931+0000 7faee6b853c0 -1 osd.7 0 log_to_monitors true 2022-03-21T13:54:16.932 INFO:tasks.ceph.osd.6.smithi171.stderr:2022-03-21T13:54:16.932+0000 7fce0b81f3c0 -1 osd.6 0 log_to_monitors true 2022-03-21T13:54:16.934 INFO:tasks.ceph.osd.2.smithi160.stderr:2022-03-21T13:54:16.933+0000 7f06296663c0 -1 osd.2 0 log_to_monitors true 2022-03-21T13:54:16.946 INFO:tasks.ceph.osd.4.smithi171.stderr:2022-03-21T13:54:16.946+0000 7fe2fb3cf3c0 -1 osd.4 0 log_to_monitors true 2022-03-21T13:54:16.950 INFO:tasks.ceph.osd.1.smithi160.stderr:2022-03-21T13:54:16.950+0000 7f96d88d53c0 -1 osd.1 0 log_to_monitors true 2022-03-21T13:54:19.397 INFO:tasks.ceph.osd.3.smithi160.stderr:2022-03-21T13:54:19.396+0000 7f437ae53700 -1 osd.3 0 waiting for initial osdmap 2022-03-21T13:54:19.401 INFO:tasks.ceph.osd.3.smithi160.stderr:2022-03-21T13:54:19.401+0000 7f43737e5700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-21T13:54:19.415 INFO:tasks.ceph.osd.0.smithi160.stderr:2022-03-21T13:54:19.414+0000 7f9159591700 -1 osd.0 0 waiting for initial osdmap 2022-03-21T13:54:19.418 INFO:tasks.ceph.osd.0.smithi160.stderr:2022-03-21T13:54:19.417+0000 7f9151f23700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-21T13:54:19.426 INFO:tasks.ceph.osd.5.smithi171.stderr:2022-03-21T13:54:19.426+0000 7f0bd1cb6700 -1 osd.5 0 waiting for initial osdmap 2022-03-21T13:54:19.434 INFO:tasks.ceph.osd.7.smithi171.stderr:2022-03-21T13:54:19.433+0000 7faedd7a8700 -1 osd.7 0 waiting for initial osdmap 2022-03-21T13:54:19.435 INFO:tasks.ceph.osd.1.smithi160.stderr:2022-03-21T13:54:19.435+0000 7f96cf4f8700 -1 osd.1 0 waiting for initial osdmap 2022-03-21T13:54:19.437 INFO:tasks.ceph.osd.5.smithi171.stderr:2022-03-21T13:54:19.436+0000 7f0bc8e45700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-21T13:54:19.438 INFO:tasks.ceph.osd.1.smithi160.stderr:2022-03-21T13:54:19.438+0000 7f96c7e8a700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-21T13:54:19.440 INFO:tasks.ceph.osd.7.smithi171.stderr:2022-03-21T13:54:19.439+0000 7faed613a700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-21T13:54:19.441 INFO:tasks.ceph.osd.4.smithi171.stderr:2022-03-21T13:54:19.441+0000 7fe2f1ff2700 -1 osd.4 0 waiting for initial osdmap 2022-03-21T13:54:19.444 INFO:tasks.ceph.osd.4.smithi171.stderr:2022-03-21T13:54:19.444+0000 7fe2ea984700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-21T13:54:19.452 INFO:tasks.ceph.osd.2.smithi160.stderr:2022-03-21T13:54:19.452+0000 7f0620289700 -1 osd.2 0 waiting for initial osdmap 2022-03-21T13:54:19.455 INFO:tasks.ceph.osd.2.smithi160.stderr:2022-03-21T13:54:19.455+0000 7f0618c1b700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-21T13:54:19.458 INFO:tasks.ceph.osd.6.smithi171.stderr:2022-03-21T13:54:19.458+0000 7fce02442700 -1 osd.6 0 waiting for initial osdmap 2022-03-21T13:54:19.461 INFO:tasks.ceph.osd.6.smithi171.stderr:2022-03-21T13:54:19.461+0000 7fcdfadd4700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-21T13:54:20.833 DEBUG:teuthology.orchestra.run.smithi160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-03-21T13:54:20.950 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.949+0000 7f3afa8d7700 1 Processor -- start 2022-03-21T13:54:20.950 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.949+0000 7f3afa8d7700 1 -- start start 2022-03-21T13:54:20.958 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.950+0000 7f3afa8d7700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3af40c49d0 0x7f3af4156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:20.958 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.950+0000 7f3afa8d7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af406d050 con 0x7f3af40bffc0 2022-03-21T13:54:20.958 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.950+0000 7f3afa8d7700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af40c04b0 con 0x7f3af40c4da0 2022-03-21T13:54:20.959 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.950+0000 7f3afa8d7700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af40c0790 con 0x7f3af40c49d0 2022-03-21T13:54:20.959 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.950+0000 7f3afa0d6700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f3af40bffc0 0x7f3af406d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59074/0 (socket says 172.21.15.160:59074) 2022-03-21T13:54:20.959 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.950+0000 7f3afa0d6700 1 -- 172.21.15.160:0/3388732919 learned_addr learned my addr 172.21.15.160:0/3388732919 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:20.959 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.950+0000 7f3af98d5700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3af40c49d0 0x7f3af4156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:20.959 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.950+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156804700 0 0) 0x7f3af406d050 con 0x7f3af40bffc0 2022-03-21T13:54:20.960 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.950+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3adc0033f0 con 0x7f3af40bffc0 2022-03-21T13:54:20.960 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2737819005 0 0) 0x7f3adc0033f0 con 0x7f3af40bffc0 2022-03-21T13:54:20.960 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3af40c49d0 msgr2=0x7f3af4156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:20.960 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3af40c49d0 0x7f3af4156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:20.961 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 >> v1:172.21.15.171:6789/0 conn(0x7f3af40c4da0 legacy=0x7f3af40c26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:20.961 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af40c0a70 con 0x7f3af40bffc0 2022-03-21T13:54:20.961 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7f3aec0017f0 con 0x7f3af40bffc0 2022-03-21T13:54:20.961 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 >> v1:172.21.15.160:6789/0 conn(0x7f3af40bffc0 legacy=0x7f3af406d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:20.961 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3af40c49d0 0x7f3adc003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:20.962 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3adc003e90 0x7f3adc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:20.962 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3adc004bd0 0x7f3adc005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:20.962 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af40c0790 con 0x7f3adc004bd0 2022-03-21T13:54:20.962 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc00ba70 con 0x7f3adc003e90 2022-03-21T13:54:20.962 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc00bc30 con 0x7f3af40c49d0 2022-03-21T13:54:20.963 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3afa0d6700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3adc004bd0 0x7f3adc005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:20.963 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af98d5700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3af40c49d0 0x7f3adc003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:20.963 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af90d4700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3adc003e90 0x7f3adc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:20.963 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3afa0d6700 1 -- 172.21.15.160:0/3388732919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3af40c49d0 msgr2=0x7f3adc003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:20.964 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3afa0d6700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3af40c49d0 0x7f3adc003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:20.964 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3afa0d6700 1 -- 172.21.15.160:0/3388732919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3adc003e90 msgr2=0x7f3adc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:20.964 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3afa0d6700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3adc003e90 0x7f3adc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:20.964 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3afa0d6700 1 -- 172.21.15.160:0/3388732919 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc0033f0 con 0x7f3adc004bd0 2022-03-21T13:54:20.964 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3afa0d6700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3adc004bd0 0x7f3adc005040 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00c5c0 tx=0x7f3af40c6200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a91ca5ae8baf9a server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:20.965 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec00cdc0 con 0x7f3adc004bd0 2022-03-21T13:54:20.965 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec005b20 con 0x7f3adc004bd0 2022-03-21T13:54:20.965 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.951+0000 7f3af88d3700 1 -- 172.21.15.160:0/3388732919 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0070d0 con 0x7f3adc004bd0 2022-03-21T13:54:20.965 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.952+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3388732919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3adc004bd0 msgr2=0x7f3adc005040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:20.966 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.952+0000 7f3afa8d7700 1 --2- 172.21.15.160:0/3388732919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3adc004bd0 0x7f3adc005040 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00c5c0 tx=0x7f3af40c6200 comp rx=0 tx=0).stop 2022-03-21T13:54:20.966 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.952+0000 7f3afa0d6700 1 -- 172.21.15.160:0/3388732919 reap_dead start 2022-03-21T13:54:20.966 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.952+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3388732919 shutdown_connections 2022-03-21T13:54:20.966 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.952+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3388732919 >> 172.21.15.160:0/3388732919 conn(0x7f3af40c56f0 msgr2=0x7f3af40c5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:20.966 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.952+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3388732919 shutdown_connections 2022-03-21T13:54:20.967 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.952+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3388732919 wait complete. 2022-03-21T13:54:20.967 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.953+0000 7f3afa8d7700 1 Processor -- start 2022-03-21T13:54:20.967 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.953+0000 7f3afa8d7700 1 -- start start 2022-03-21T13:54:20.967 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3afa8d7700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3adc004bd0 0x7f3af41656a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:20.968 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3afa8d7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3af414a4b0 0x7f3af4164440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:20.968 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3afa8d7700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3af4164980 0x7f3af414d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:20.968 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3afa8d7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4163f60 con 0x7f3af414a4b0 2022-03-21T13:54:20.968 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3afa8d7700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af41500c0 con 0x7f3af4164980 2022-03-21T13:54:20.968 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3afa8d7700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4164dd0 con 0x7f3adc004bd0 2022-03-21T13:54:20.969 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3af90d4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3af414a4b0 0x7f3af4164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:20.969 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3af90d4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3af414a4b0 0x7f3af4164440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:55932/0 (socket says 172.21.15.160:55932) 2022-03-21T13:54:20.969 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3af90d4700 1 -- 172.21.15.160:0/3875506154 learned_addr learned my addr 172.21.15.160:0/3875506154 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:20.969 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3af98d5700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3adc004bd0 0x7f3af41656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:20.970 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3afa0d6700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3af4164980 0x7f3af414d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:20.970 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3af90d4700 1 -- 172.21.15.160:0/3875506154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3adc004bd0 msgr2=0x7f3af41656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:20.970 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3af90d4700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3adc004bd0 0x7f3af41656a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:20.970 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3af90d4700 1 -- 172.21.15.160:0/3875506154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3af4164980 msgr2=0x7f3af414d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:20.970 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3af90d4700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3af4164980 0x7f3af414d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:20.971 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3af90d4700 1 -- 172.21.15.160:0/3875506154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af414fde0 con 0x7f3af414a4b0 2022-03-21T13:54:20.971 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3afa0d6700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3af4164980 0x7f3af414d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:20.971 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3af90d4700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3af414a4b0 0x7f3af4164440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4001050 tx=0x7f3ae4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:20.972 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3ae1ffb700 1 -- 172.21.15.160:0/3875506154 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40052e0 con 0x7f3af414a4b0 2022-03-21T13:54:20.972 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3ae1ffb700 1 -- 172.21.15.160:0/3875506154 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae40034c0 con 0x7f3af414a4b0 2022-03-21T13:54:20.972 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.954+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3875506154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af4163620 con 0x7f3af414a4b0 2022-03-21T13:54:20.972 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.955+0000 7f3ae1ffb700 1 -- 172.21.15.160:0/3875506154 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4003860 con 0x7f3af414a4b0 2022-03-21T13:54:20.973 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.955+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3875506154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af414f410 con 0x7f3af414a4b0 2022-03-21T13:54:20.973 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.956+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3875506154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af4070ae0 con 0x7f3af414a4b0 2022-03-21T13:54:20.973 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.956+0000 7f3ae1ffb700 1 -- 172.21.15.160:0/3875506154 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 4) v1 ==== 81882+0+0 (secure 0 0 0) 0x7f3ae4003bd0 con 0x7f3af414a4b0 2022-03-21T13:54:20.973 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.956+0000 7f3ae1ffb700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ad4063cc0 0x7f3ad4066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:20.974 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.956+0000 7f3ae1ffb700 1 -- 172.21.15.160:0/3875506154 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f3ae4080100 con 0x7f3af414a4b0 2022-03-21T13:54:20.974 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.956+0000 7f3af98d5700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ad4063cc0 0x7f3ad4066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:20.974 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.957+0000 7f3af98d5700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ad4063cc0 0x7f3ad4066170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3af0006d80 tx=0x7f3af0009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:20.975 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:20.961+0000 7f3ae1ffb700 1 -- 172.21.15.160:0/3875506154 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f3ae404f360 con 0x7f3af414a4b0 2022-03-21T13:54:21.133 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.132+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3875506154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3af40c0d50 con 0x7f3af414a4b0 2022-03-21T13:54:21.134 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.133+0000 7f3ae1ffb700 1 -- 172.21.15.160:0/3875506154 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10423 (secure 0 0 0) 0x7f3ae4003e60 con 0x7f3af414a4b0 2022-03-21T13:54:21.134 INFO:teuthology.misc.health.smithi160.stdout: 2022-03-21T13:54:21.134 INFO:teuthology.misc.health.smithi160.stdout:{"epoch":13,"fsid":"b2a3ddc8-064e-4cc9-8187-33ea19afd50a","created":"2022-03-21T13:54:10.384226+0000","modified":"2022-03-21T13:54:20.412036+0000","last_up_change":"2022-03-21T13:54:20.412036+0000","last_in_change":"2022-03-21T13:54:12.760084+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"828ac39d-86ad-44a1-bb66-c99786642970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":25441},{"type":"v1","addr":"172.21.15.160:6810","nonce":25441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":25441},{"type":"v1","addr":"172.21.15.160:6814","nonce":25441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":25441},{"type":"v1","addr":"172.21.15.160:6822","nonce":25441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":25441},{"type":"v1","addr":"172.21.15.160:6818","nonce":25441}]},"public_addr":"172.21.15.160:6810/25441","cluster_addr":"172.21.15.160:6814/25441","heartbeat_back_addr":"172.21.15.160:6822/25441","heartbeat_front_addr":"172.21.15.160:6818/25441","state":["exists","up"]},{"osd":1,"uuid":"464764e2-a47e-43c0-8c93-b6bfd10ba526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":25442},{"type":"v1","addr":"172.21.15.160:6825","nonce":25442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":25442},{"type":"v1","addr":"172.21.15.160:6827","nonce":25442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":25442},{"type":"v1","addr":"172.21.15.160:6831","nonce":25442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":25442},{"type":"v1","addr":"172.21.15.160:6829","nonce":25442}]},"public_addr":"172.21.15.160:6825/25442","cluster_addr":"172.21.15.160:6827/25442","heartbeat_back_addr":"172.21.15.160:6831/25442","heartbeat_front_addr":"172.21.15.160:6829/25442","state":["exists","up"]},{"osd":2,"uuid":"4dbfea57-14b6-4c67-8312-fc7d71ef77a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":25443},{"type":"v1","addr":"172.21.15.160:6811","nonce":25443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6813","nonce":25443},{"type":"v1","addr":"172.21.15.160:6815","nonce":25443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":25443},{"type":"v1","addr":"172.21.15.160:6823","nonce":25443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":25443},{"type":"v1","addr":"172.21.15.160:6819","nonce":25443}]},"public_addr":"172.21.15.160:6811/25443","cluster_addr":"172.21.15.160:6815/25443","heartbeat_back_addr":"172.21.15.160:6823/25443","heartbeat_front_addr":"172.21.15.160:6819/25443","state":["exists","up"]},{"osd":3,"uuid":"c53ed58d-a1f3-4783-8677-9348a1d103f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":25440},{"type":"v1","addr":"172.21.15.160:6801","nonce":25440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":25440},{"type":"v1","addr":"172.21.15.160:6803","nonce":25440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":25440},{"type":"v1","addr":"172.21.15.160:6807","nonce":25440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":25440},{"type":"v1","addr":"172.21.15.160:6805","nonce":25440}]},"public_addr":"172.21.15.160:6801/25440","cluster_addr":"172.21.15.160:6803/25440","heartbeat_back_addr":"172.21.15.160:6807/25440","heartbeat_front_addr":"172.21.15.160:6805/25440","state":["exists","up"]},{"osd":4,"uuid":"5713dbd4-1736-4ebf-8102-e80f4db6bcc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":25559},{"type":"v1","addr":"172.21.15.171:6817","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":25559},{"type":"v1","addr":"172.21.15.171:6819","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":25559},{"type":"v1","addr":"172.21.15.171:6826","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":25559},{"type":"v1","addr":"172.21.15.171:6821","nonce":25559}]},"public_addr":"172.21.15.171:6817/25559","cluster_addr":"172.21.15.171:6819/25559","heartbeat_back_addr":"172.21.15.171:6826/25559","heartbeat_front_addr":"172.21.15.171:6821/25559","state":["exists","up"]},{"osd":5,"uuid":"dfe21128-6ae6-4662-9f47-1bbb423a2232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":25549},{"type":"v1","addr":"172.21.15.171:6801","nonce":25549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":25549},{"type":"v1","addr":"172.21.15.171:6803","nonce":25549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":25549},{"type":"v1","addr":"172.21.15.171:6807","nonce":25549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":25549},{"type":"v1","addr":"172.21.15.171:6805","nonce":25549}]},"public_addr":"172.21.15.171:6801/25549","cluster_addr":"172.21.15.171:6803/25549","heartbeat_back_addr":"172.21.15.171:6807/25549","heartbeat_front_addr":"172.21.15.171:6805/25549","state":["exists","up"]},{"osd":6,"uuid":"24a9b956-5fa1-41bf-a689-0f048b7f19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":25574},{"type":"v1","addr":"172.21.15.171:6823","nonce":25574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":25574},{"type":"v1","addr":"172.21.15.171:6827","nonce":25574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":25574},{"type":"v1","addr":"172.21.15.171:6831","nonce":25574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":25574},{"type":"v1","addr":"172.21.15.171:6829","nonce":25574}]},"public_addr":"172.21.15.171:6823/25574","cluster_addr":"172.21.15.171:6827/25574","heartbeat_back_addr":"172.21.15.171:6831/25574","heartbeat_front_addr":"172.21.15.171:6829/25574","state":["exists","up"]},{"osd":7,"uuid":"a5ab4a14-8a7b-43b8-932c-a950f81c10f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":25550},{"type":"v1","addr":"172.21.15.171:6809","nonce":25550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":25550},{"type":"v1","addr":"172.21.15.171:6811","nonce":25550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":25550},{"type":"v1","addr":"172.21.15.171:6815","nonce":25550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":25550},{"type":"v1","addr":"172.21.15.171:6813","nonce":25550}]},"public_addr":"172.21.15.171:6809/25550","cluster_addr":"172.21.15.171:6811/25550","heartbeat_back_addr":"172.21.15.171:6815/25550","heartbeat_front_addr":"172.21.15.171:6813/25550","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-21T13:54:21.136 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3875506154 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ad4063cc0 msgr2=0x7f3ad4066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.136 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ad4063cc0 0x7f3ad4066170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3af0006d80 tx=0x7f3af0009060 comp rx=0 tx=0).stop 2022-03-21T13:54:21.137 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3875506154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3af414a4b0 msgr2=0x7f3af4164440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.137 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3af414a4b0 0x7f3af4164440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4001050 tx=0x7f3ae4009040 comp rx=0 tx=0).stop 2022-03-21T13:54:21.137 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3875506154 shutdown_connections 2022-03-21T13:54:21.137 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ad4063cc0 0x7f3ad4066170 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.138 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3af4164980 0x7f3af414d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.138 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3adc004bd0 0x7f3af41656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.138 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 --2- 172.21.15.160:0/3875506154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3af414a4b0 0x7f3af4164440 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.138 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3875506154 >> 172.21.15.160:0/3875506154 conn(0x7f3af40c56f0 msgr2=0x7f3af414c330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:21.139 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3875506154 shutdown_connections 2022-03-21T13:54:21.139 INFO:teuthology.misc.health.smithi160.stderr:2022-03-21T13:54:21.135+0000 7f3afa8d7700 1 -- 172.21.15.160:0/3875506154 wait complete. 2022-03-21T13:54:21.146 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-03-21T13:54:21.147 INFO:tasks.ceph:Creating RBD pool 2022-03-21T13:54:21.147 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd pool create rbd 8 2022-03-21T13:54:21.260 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.259+0000 7f976b697700 1 Processor -- start 2022-03-21T13:54:21.261 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.259+0000 7f976b697700 1 -- start start 2022-03-21T13:54:21.266 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.260+0000 7f976b697700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f976414eb10 0x7f976405dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:21.267 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.260+0000 7f976b697700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9764158ca0 con 0x7f97640c2440 2022-03-21T13:54:21.267 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.260+0000 7f976b697700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976405e1c0 con 0x7f976414eee0 2022-03-21T13:54:21.267 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.260+0000 7f976b697700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97640c1130 con 0x7f976414eb10 2022-03-21T13:54:21.268 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.260+0000 7f9769433700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f976414eb10 0x7f976405dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:21.268 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.260+0000 7f9769c34700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f97640c2440 0x7f9764154be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59094/0 (socket says 172.21.15.160:59094) 2022-03-21T13:54:21.268 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.260+0000 7f9769c34700 1 -- 172.21.15.160:0/1907409227 learned_addr learned my addr 172.21.15.160:0/1907409227 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:21.268 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f9769433700 1 -- 172.21.15.160:0/1907409227 >> v1:172.21.15.171:6789/0 conn(0x7f976414eee0 legacy=0x7f97640c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.268 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f9769433700 1 -- 172.21.15.160:0/1907409227 >> v1:172.21.15.160:6789/0 conn(0x7f97640c2440 legacy=0x7f9764154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f9769433700 1 -- 172.21.15.160:0/1907409227 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764158090 con 0x7f976414eb10 2022-03-21T13:54:21.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f9757fff700 1 -- 172.21.15.160:0/1907409227 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239380992 0 0) 0x7f9764158ca0 con 0x7f97640c2440 2022-03-21T13:54:21.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f9769433700 1 --2- 172.21.15.160:0/1907409227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f976414eb10 0x7f976405dc80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f975c009e60 tx=0x7f975c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199bda3b27b9e39f server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:21.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f9757fff700 1 -- 172.21.15.160:0/1907409227 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c00e070 con 0x7f976414eb10 2022-03-21T13:54:21.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f9757fff700 1 -- 172.21.15.160:0/1907409227 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c00bc30 con 0x7f976414eb10 2022-03-21T13:54:21.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f9757fff700 1 -- 172.21.15.160:0/1907409227 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c012430 con 0x7f976414eb10 2022-03-21T13:54:21.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f976b697700 1 -- 172.21.15.160:0/1907409227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f976414eb10 msgr2=0x7f976405dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.271 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f976b697700 1 --2- 172.21.15.160:0/1907409227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f976414eb10 0x7f976405dc80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f975c009e60 tx=0x7f975c009780 comp rx=0 tx=0).stop 2022-03-21T13:54:21.271 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f976b697700 1 -- 172.21.15.160:0/1907409227 shutdown_connections 2022-03-21T13:54:21.271 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f976b697700 1 --2- 172.21.15.160:0/1907409227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f976414eb10 0x7f976405dc80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.272 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.261+0000 7f976b697700 1 -- 172.21.15.160:0/1907409227 >> 172.21.15.160:0/1907409227 conn(0x7f97640c3f20 msgr2=0x7f97640c42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:21.272 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.262+0000 7f976b697700 1 -- 172.21.15.160:0/1907409227 shutdown_connections 2022-03-21T13:54:21.272 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.262+0000 7f976b697700 1 -- 172.21.15.160:0/1907409227 wait complete. 2022-03-21T13:54:21.272 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.263+0000 7f976b697700 1 Processor -- start 2022-03-21T13:54:21.273 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.263+0000 7f976b697700 1 -- start start 2022-03-21T13:54:21.273 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.263+0000 7f976b697700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97640c2440 0x7f9764164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:21.273 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.263+0000 7f976b697700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f976414eb10 0x7f976405d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:21.273 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.263+0000 7f976b697700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f976414eee0 0x7f9764145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:21.273 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.263+0000 7f976b697700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97641574b0 con 0x7f976414eee0 2022-03-21T13:54:21.274 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.263+0000 7f976b697700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9764165100 con 0x7f97640c2440 2022-03-21T13:54:21.274 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.263+0000 7f976b697700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97640c53a0 con 0x7f976414eb10 2022-03-21T13:54:21.274 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9769c34700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f976414eee0 0x7f9764145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:21.274 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9769c34700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f976414eee0 0x7f9764145ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:55948/0 (socket says 172.21.15.160:55948) 2022-03-21T13:54:21.275 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9769c34700 1 -- 172.21.15.160:0/2702175043 learned_addr learned my addr 172.21.15.160:0/2702175043 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:21.275 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9768c32700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f976414eb10 0x7f976405d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:21.275 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9769433700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97640c2440 0x7f9764164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:21.275 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9769c34700 1 -- 172.21.15.160:0/2702175043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f976414eb10 msgr2=0x7f976405d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9769c34700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f976414eb10 0x7f976405d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9769c34700 1 -- 172.21.15.160:0/2702175043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97640c2440 msgr2=0x7f9764164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9769c34700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97640c2440 0x7f9764164bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9769c34700 1 -- 172.21.15.160:0/2702175043 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c009a20 con 0x7f976414eee0 2022-03-21T13:54:21.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9769433700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97640c2440 0x7f9764164bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:21.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f9769c34700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f976414eee0 0x7f9764145ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f976000c4c0 tx=0x7f9760007bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:21.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f97557fa700 1 -- 172.21.15.160:0/2702175043 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760007360 con 0x7f976414eee0 2022-03-21T13:54:21.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f97557fa700 1 -- 172.21.15.160:0/2702175043 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97600074c0 con 0x7f976414eee0 2022-03-21T13:54:21.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f97557fa700 1 -- 172.21.15.160:0/2702175043 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760004900 con 0x7f976414eee0 2022-03-21T13:54:21.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f976b697700 1 -- 172.21.15.160:0/2702175043 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97640c5680 con 0x7f976414eee0 2022-03-21T13:54:21.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.264+0000 7f976b697700 1 -- 172.21.15.160:0/2702175043 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9764156e60 con 0x7f976414eee0 2022-03-21T13:54:21.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.265+0000 7f976b697700 1 -- 172.21.15.160:0/2702175043 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9764157620 con 0x7f976414eee0 2022-03-21T13:54:21.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.265+0000 7f97557fa700 1 -- 172.21.15.160:0/2702175043 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 4) v1 ==== 81882+0+0 (secure 0 0 0) 0x7f9760010030 con 0x7f976414eee0 2022-03-21T13:54:21.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.266+0000 7f97557fa700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9744063c90 0x7f9744066140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:21.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.266+0000 7f97557fa700 1 -- 172.21.15.160:0/2702175043 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f976007fd10 con 0x7f976414eee0 2022-03-21T13:54:21.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.266+0000 7f9769433700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9744063c90 0x7f9744066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:21.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.266+0000 7f9769433700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9744063c90 0x7f9744066140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f975c009e60 tx=0x7f975c019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:21.280 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.270+0000 7f97557fa700 1 -- 172.21.15.160:0/2702175043 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f976004eff0 con 0x7f976414eee0 2022-03-21T13:54:21.441 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.440+0000 7f976b697700 1 -- 172.21.15.160:0/2702175043 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f9764158370 con 0x7f976414eee0 2022-03-21T13:54:21.506 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.506+0000 7f97557fa700 1 -- 172.21.15.160:0/2702175043 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f9760052610 con 0x7f976414eee0 2022-03-21T13:54:21.509 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 -- 172.21.15.160:0/2702175043 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9744063c90 msgr2=0x7f9744066140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.510 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9744063c90 0x7f9744066140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f975c009e60 tx=0x7f975c019000 comp rx=0 tx=0).stop 2022-03-21T13:54:21.510 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 -- 172.21.15.160:0/2702175043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f976414eee0 msgr2=0x7f9764145ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.510 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f976414eee0 0x7f9764145ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f976000c4c0 tx=0x7f9760007bf0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.510 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 -- 172.21.15.160:0/2702175043 shutdown_connections 2022-03-21T13:54:21.510 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9744063c90 0x7f9744066140 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.511 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f976414eee0 0x7f9764145ee0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.511 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97640c2440 0x7f9764164bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.511 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 --2- 172.21.15.160:0/2702175043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f976414eb10 0x7f976405d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.511 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 -- 172.21.15.160:0/2702175043 >> 172.21.15.160:0/2702175043 conn(0x7f97640c3f20 msgr2=0x7f9764067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:21.512 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 -- 172.21.15.160:0/2702175043 shutdown_connections 2022-03-21T13:54:21.512 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.508+0000 7f976b697700 1 -- 172.21.15.160:0/2702175043 wait complete. 2022-03-21T13:54:21.512 INFO:teuthology.orchestra.run.smithi160.stderr:pool 'rbd' created 2022-03-21T13:54:21.520 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-03-21T13:54:21.634 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.634+0000 7f931759e700 1 Processor -- start 2022-03-21T13:54:21.635 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.634+0000 7f931759e700 1 -- start start 2022-03-21T13:54:21.638 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f931759e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93180b71b0 0x7f93180b7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:21.638 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f931759e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f931805dc80 0x7f93180c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:21.638 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f931759e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93180c7f10 con 0x7f93180c0120 2022-03-21T13:54:21.638 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f931759e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93180bf320 con 0x7f931805dc80 2022-03-21T13:54:21.639 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f931759e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93180c27b0 con 0x7f93180b71b0 2022-03-21T13:54:21.639 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f9315d9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f931805dc80 0x7f93180c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:21.639 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f9315d9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f931805dc80 0x7f93180c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:55964/0 (socket says 172.21.15.160:55964) 2022-03-21T13:54:21.639 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f9316d9d700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f93180c0120 0x7f931806c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59118/0 (socket says 172.21.15.160:59118) 2022-03-21T13:54:21.640 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f9315d9b700 1 -- 172.21.15.160:0/2817761028 learned_addr learned my addr 172.21.15.160:0/2817761028 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:21.640 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f931659c700 1 --2- 172.21.15.160:0/2817761028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93180b71b0 0x7f93180b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:21.640 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f9315d9b700 1 -- 172.21.15.160:0/2817761028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93180b71b0 msgr2=0x7f93180b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:21.640 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f9315d9b700 1 --2- 172.21.15.160:0/2817761028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93180b71b0 0x7f93180b7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.641 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f9315d9b700 1 -- 172.21.15.160:0/2817761028 >> v1:172.21.15.160:6789/0 conn(0x7f93180c0120 legacy=0x7f931806c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.641 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f931559a700 1 -- 172.21.15.160:0/2817761028 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219625012 0 0) 0x7f9308001110 con 0x7f93180c0120 2022-03-21T13:54:21.641 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f9315d9b700 1 -- 172.21.15.160:0/2817761028 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931806c070 con 0x7f931805dc80 2022-03-21T13:54:21.641 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f9315d9b700 1 --2- 172.21.15.160:0/2817761028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931805dc80 0x7f93180c79d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9300006fd0 tx=0x7f93000090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3c05e1365e92df server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:21.641 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f931559a700 1 -- 172.21.15.160:0/2817761028 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300004030 con 0x7f931805dc80 2022-03-21T13:54:21.642 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f931559a700 1 -- 172.21.15.160:0/2817761028 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9300004190 con 0x7f931805dc80 2022-03-21T13:54:21.642 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.635+0000 7f931559a700 1 -- 172.21.15.160:0/2817761028 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300011630 con 0x7f931805dc80 2022-03-21T13:54:21.642 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.636+0000 7f931759e700 1 -- 172.21.15.160:0/2817761028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931805dc80 msgr2=0x7f93180c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.642 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.636+0000 7f931759e700 1 --2- 172.21.15.160:0/2817761028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931805dc80 0x7f93180c79d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9300006fd0 tx=0x7f93000090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.643 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.636+0000 7f931759e700 1 -- 172.21.15.160:0/2817761028 shutdown_connections 2022-03-21T13:54:21.643 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.636+0000 7f931759e700 1 --2- 172.21.15.160:0/2817761028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93180b71b0 0x7f93180b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.643 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.636+0000 7f931759e700 1 --2- 172.21.15.160:0/2817761028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931805dc80 0x7f93180c79d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.643 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.636+0000 7f931759e700 1 -- 172.21.15.160:0/2817761028 >> 172.21.15.160:0/2817761028 conn(0x7f9318068c80 msgr2=0x7f93180c72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:21.643 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.636+0000 7f931759e700 1 -- 172.21.15.160:0/2817761028 shutdown_connections 2022-03-21T13:54:21.644 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.636+0000 7f931759e700 1 -- 172.21.15.160:0/2817761028 wait complete. 2022-03-21T13:54:21.644 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.637+0000 7f931759e700 1 Processor -- start 2022-03-21T13:54:21.644 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.637+0000 7f931759e700 1 -- start start 2022-03-21T13:54:21.647 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f931759e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f931805dc80 0x7f93180b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:21.648 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f931759e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93180b71b0 0x7f93180bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:21.648 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f931759e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93180c0120 0x7f931814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:21.648 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f931759e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93180bddf0 con 0x7f93180b71b0 2022-03-21T13:54:21.648 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f931759e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93180be090 con 0x7f931805dc80 2022-03-21T13:54:21.649 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f931759e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93180b4890 con 0x7f93180c0120 2022-03-21T13:54:21.649 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f9315d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93180b71b0 0x7f93180bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:21.649 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f9315d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93180b71b0 0x7f93180bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:55970/0 (socket says 172.21.15.160:55970) 2022-03-21T13:54:21.649 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f9315d9b700 1 -- 172.21.15.160:0/207163916 learned_addr learned my addr 172.21.15.160:0/207163916 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:21.649 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f931659c700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f931805dc80 0x7f93180b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:21.650 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f9316d9d700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93180c0120 0x7f931814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:21.650 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f9315d9b700 1 -- 172.21.15.160:0/207163916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93180c0120 msgr2=0x7f931814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.650 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f9315d9b700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93180c0120 0x7f931814fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.650 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f9315d9b700 1 -- 172.21.15.160:0/207163916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f931805dc80 msgr2=0x7f93180b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:21.651 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f9315d9b700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f931805dc80 0x7f93180b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:21.651 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f9315d9b700 1 -- 172.21.15.160:0/207163916 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9300009370 con 0x7f93180b71b0 2022-03-21T13:54:21.651 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f9315d9b700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93180b71b0 0x7f93180bbf60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9300008000 tx=0x7f9300016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:21.651 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.638+0000 7f930e7fc700 1 -- 172.21.15.160:0/207163916 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000036f0 con 0x7f93180b71b0 2022-03-21T13:54:21.651 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.639+0000 7f930e7fc700 1 -- 172.21.15.160:0/207163916 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9300003870 con 0x7f93180b71b0 2022-03-21T13:54:21.652 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.639+0000 7f930e7fc700 1 -- 172.21.15.160:0/207163916 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300003c30 con 0x7f93180b71b0 2022-03-21T13:54:21.652 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.639+0000 7f931759e700 1 -- 172.21.15.160:0/207163916 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93180b4b70 con 0x7f93180b71b0 2022-03-21T13:54:21.652 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.639+0000 7f931759e700 1 -- 172.21.15.160:0/207163916 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93180b5130 con 0x7f93180b71b0 2022-03-21T13:54:21.652 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.639+0000 7f931759e700 1 -- 172.21.15.160:0/207163916 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9318069eb0 con 0x7f93180b71b0 2022-03-21T13:54:21.653 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.640+0000 7f930e7fc700 1 -- 172.21.15.160:0/207163916 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 4) v1 ==== 81882+0+0 (secure 0 0 0) 0x7f9300017020 con 0x7f93180b71b0 2022-03-21T13:54:21.653 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.640+0000 7f930e7fc700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f92fc063c90 0x7f92fc066140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:21.653 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.640+0000 7f930e7fc700 1 -- 172.21.15.160:0/207163916 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5184+0+0 (secure 0 0 0) 0x7f9300081e00 con 0x7f93180b71b0 2022-03-21T13:54:21.653 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.640+0000 7f931659c700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f92fc063c90 0x7f92fc066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:21.653 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.641+0000 7f931659c700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f92fc063c90 0x7f92fc066140 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f931000f610 tx=0x7f93100077f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:21.654 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.644+0000 7f930e7fc700 1 -- 172.21.15.160:0/207163916 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f9300050cd0 con 0x7f93180b71b0 2022-03-21T13:54:21.817 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:21.816+0000 7f931759e700 1 -- 172.21.15.160:0/207163916 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f931804b760 con 0x7f93180b71b0 2022-03-21T13:54:22.511 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.510+0000 7f930e7fc700 1 -- 172.21.15.160:0/207163916 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f930002a030 con 0x7f93180b71b0 2022-03-21T13:54:22.515 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.513+0000 7f931759e700 1 -- 172.21.15.160:0/207163916 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f92fc063c90 msgr2=0x7f92fc066140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:22.515 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.514+0000 7f931759e700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f92fc063c90 0x7f92fc066140 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f931000f610 tx=0x7f93100077f0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.515 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.514+0000 7f931759e700 1 -- 172.21.15.160:0/207163916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93180b71b0 msgr2=0x7f93180bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:22.515 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.514+0000 7f931759e700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93180b71b0 0x7f93180bbf60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9300008000 tx=0x7f9300016000 comp rx=0 tx=0).stop 2022-03-21T13:54:22.516 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.514+0000 7f931759e700 1 -- 172.21.15.160:0/207163916 shutdown_connections 2022-03-21T13:54:22.516 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.514+0000 7f931759e700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f92fc063c90 0x7f92fc066140 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.516 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.514+0000 7f931759e700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93180c0120 0x7f931814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.516 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.514+0000 7f931759e700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f931805dc80 0x7f93180b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.516 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.514+0000 7f931759e700 1 --2- 172.21.15.160:0/207163916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93180b71b0 0x7f93180bbf60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.517 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.514+0000 7f931759e700 1 -- 172.21.15.160:0/207163916 >> 172.21.15.160:0/207163916 conn(0x7f9318068c80 msgr2=0x7f93180c5570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:22.517 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.514+0000 7f931759e700 1 -- 172.21.15.160:0/207163916 shutdown_connections 2022-03-21T13:54:22.517 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.514+0000 7f931759e700 1 -- 172.21.15.160:0/207163916 wait complete. 2022-03-21T13:54:22.518 INFO:teuthology.orchestra.run.smithi160.stderr:enabled application 'rbd' on pool 'rbd' 2022-03-21T13:54:22.529 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-03-21T13:54:22.530 INFO:tasks.ceph.mds.a:Restarting daemon 2022-03-21T13:54:22.531 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-03-21T13:54:22.533 INFO:tasks.ceph.mds.a:Started 2022-03-21T13:54:22.534 INFO:tasks.ceph.mds.c:Restarting daemon 2022-03-21T13:54:22.534 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-03-21T13:54:22.536 INFO:tasks.ceph.mds.c:Started 2022-03-21T13:54:22.536 INFO:tasks.ceph.mds.e:Restarting daemon 2022-03-21T13:54:22.537 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2022-03-21T13:54:22.539 INFO:tasks.ceph.mds.e:Started 2022-03-21T13:54:22.539 INFO:tasks.ceph.mds.b:Restarting daemon 2022-03-21T13:54:22.540 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-03-21T13:54:22.542 INFO:tasks.ceph.mds.b:Started 2022-03-21T13:54:22.543 INFO:tasks.ceph.mds.d:Restarting daemon 2022-03-21T13:54:22.543 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-03-21T13:54:22.545 INFO:tasks.ceph.mds.d:Started 2022-03-21T13:54:22.546 INFO:tasks.ceph.mds.f:Restarting daemon 2022-03-21T13:54:22.546 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2022-03-21T13:54:22.548 INFO:tasks.ceph.mds.f:Started 2022-03-21T13:54:22.549 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-03-21T13:54:22.549 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-21T13:54:22.619 INFO:tasks.ceph.mds.c.smithi160.stdout:starting mds.c at 2022-03-21T13:54:22.620 INFO:tasks.ceph.mds.a.smithi160.stdout:starting mds.a at 2022-03-21T13:54:22.625 INFO:tasks.ceph.mds.e.smithi160.stdout:starting mds.e at 2022-03-21T13:54:22.627 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2022-03-21T13:54:22.632 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2022-03-21T13:54:22.639 INFO:tasks.ceph.mds.f.smithi171.stdout:starting mds.f at 2022-03-21T13:54:22.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.689+0000 7f99a008c700 1 Processor -- start 2022-03-21T13:54:22.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.689+0000 7f99a008c700 1 -- start start 2022-03-21T13:54:22.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.690+0000 7f99a008c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99980c41f0 0x7f999806c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:22.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.690+0000 7f99a008c700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f999815c750 0x7f999815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:22.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.690+0000 7f99a008c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999806e980 con 0x7f99980c3e20 2022-03-21T13:54:22.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.690+0000 7f99a008c700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999806d4a0 con 0x7f999815c750 2022-03-21T13:54:22.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.690+0000 7f99a008c700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999815d130 con 0x7f99980c41f0 2022-03-21T13:54:22.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.690+0000 7f999de28700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f99980c3e20 0x7f99980b7fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59216/0 (socket says 172.21.15.160:59216) 2022-03-21T13:54:22.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.690+0000 7f999de28700 1 -- 172.21.15.160:0/2382461378 learned_addr learned my addr 172.21.15.160:0/2382461378 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:22.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.690+0000 7f999e629700 1 --2- 172.21.15.160:0/2382461378 >> v2:172.21.15.171:3300/0 conn(0x7f999815c750 0x7f999815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:22.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.690+0000 7f999d627700 1 --2- 172.21.15.160:0/2382461378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99980c41f0 0x7f999806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:22.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.690+0000 7f999ce26700 1 -- 172.21.15.160:0/2382461378 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697811367 0 0) 0x7f999806e980 con 0x7f99980c3e20 2022-03-21T13:54:22.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.690+0000 7f999ce26700 1 -- 172.21.15.160:0/2382461378 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99800033f0 con 0x7f99980c3e20 2022-03-21T13:54:22.699 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f999e629700 1 -- 172.21.15.160:0/2382461378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99980c41f0 msgr2=0x7f999806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:22.699 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f999e629700 1 --2- 172.21.15.160:0/2382461378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99980c41f0 0x7f999806c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.699 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f999e629700 1 -- 172.21.15.160:0/2382461378 >> v1:172.21.15.160:6789/0 conn(0x7f99980c3e20 legacy=0x7f99980b7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:22.699 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f999e629700 1 -- 172.21.15.160:0/2382461378 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999806c670 con 0x7f999815c750 2022-03-21T13:54:22.699 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f999e629700 1 --2- 172.21.15.160:0/2382461378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f999815c750 0x7f999815cbf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9990009750 tx=0x7f9990006f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56f440b71fb9b9b0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:22.700 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f999ce26700 1 -- 172.21.15.160:0/2382461378 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990005ae0 con 0x7f999815c750 2022-03-21T13:54:22.700 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f999ce26700 1 -- 172.21.15.160:0/2382461378 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9990005c40 con 0x7f999815c750 2022-03-21T13:54:22.700 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f999ce26700 1 -- 172.21.15.160:0/2382461378 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990006030 con 0x7f999815c750 2022-03-21T13:54:22.700 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f99a008c700 1 -- 172.21.15.160:0/2382461378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f999815c750 msgr2=0x7f999815cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:22.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f99a008c700 1 --2- 172.21.15.160:0/2382461378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f999815c750 0x7f999815cbf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9990009750 tx=0x7f9990006f90 comp rx=0 tx=0).stop 2022-03-21T13:54:22.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f99a008c700 1 -- 172.21.15.160:0/2382461378 shutdown_connections 2022-03-21T13:54:22.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f99a008c700 1 --2- 172.21.15.160:0/2382461378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f999815c750 0x7f999815cbf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f99a008c700 1 --2- 172.21.15.160:0/2382461378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99980c41f0 0x7f999806c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f99a008c700 1 -- 172.21.15.160:0/2382461378 >> 172.21.15.160:0/2382461378 conn(0x7f99980c87e0 msgr2=0x7f99980c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:22.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.691+0000 7f99a008c700 1 -- 172.21.15.160:0/2382461378 shutdown_connections 2022-03-21T13:54:22.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.692+0000 7f99a008c700 1 -- 172.21.15.160:0/2382461378 wait complete. 2022-03-21T13:54:22.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.692+0000 7f99a008c700 1 Processor -- start 2022-03-21T13:54:22.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f99a008c700 1 -- start start 2022-03-21T13:54:22.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f99a008c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99980c3e20 0x7f9998159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:22.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f99a008c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99980c41f0 0x7f99980b9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:22.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f99a008c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f999815c750 0x7f99980ba530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:22.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f99a008c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99980bb740 con 0x7f99980c41f0 2022-03-21T13:54:22.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f99a008c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99980b9860 con 0x7f999815c750 2022-03-21T13:54:22.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f99a008c700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99981589c0 con 0x7f99980c3e20 2022-03-21T13:54:22.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f999d627700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99980c41f0 0x7f99980b9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:22.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f999d627700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99980c41f0 0x7f99980b9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56072/0 (socket says 172.21.15.160:56072) 2022-03-21T13:54:22.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f999d627700 1 -- 172.21.15.160:0/1255976486 learned_addr learned my addr 172.21.15.160:0/1255976486 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:22.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f999de28700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99980c3e20 0x7f9998159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:22.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.693+0000 7f999e629700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f999815c750 0x7f99980ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:22.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.694+0000 7f999d627700 1 -- 172.21.15.160:0/1255976486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99980c3e20 msgr2=0x7f9998159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:22.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.694+0000 7f999d627700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99980c3e20 0x7f9998159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.694+0000 7f999d627700 1 -- 172.21.15.160:0/1255976486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f999815c750 msgr2=0x7f99980ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:22.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.694+0000 7f999d627700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f999815c750 0x7f99980ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.694+0000 7f999d627700 1 -- 172.21.15.160:0/1255976486 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9990009290 con 0x7f99980c41f0 2022-03-21T13:54:22.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.694+0000 7f999d627700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99980c41f0 0x7f99980b9ff0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f998800e930 tx=0x7f9988009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:22.707 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.694+0000 7f9985ffb700 1 -- 172.21.15.160:0/1255976486 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988013680 con 0x7f99980c41f0 2022-03-21T13:54:22.707 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.694+0000 7f9985ffb700 1 -- 172.21.15.160:0/1255976486 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99880137e0 con 0x7f99980c41f0 2022-03-21T13:54:22.707 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.694+0000 7f99a008c700 1 -- 172.21.15.160:0/1255976486 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9998158c60 con 0x7f99980c41f0 2022-03-21T13:54:22.707 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.694+0000 7f9985ffb700 1 -- 172.21.15.160:0/1255976486 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988013b60 con 0x7f99980c41f0 2022-03-21T13:54:22.707 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.694+0000 7f99a008c700 1 -- 172.21.15.160:0/1255976486 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9998156e60 con 0x7f99980c41f0 2022-03-21T13:54:22.708 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.695+0000 7f99a008c700 1 -- 172.21.15.160:0/1255976486 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999806fc00 con 0x7f99980c41f0 2022-03-21T13:54:22.708 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.695+0000 7f9985ffb700 1 -- 172.21.15.160:0/1255976486 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 4) v1 ==== 81882+0+0 (secure 0 0 0) 0x7f9988023070 con 0x7f99980c41f0 2022-03-21T13:54:22.709 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.696+0000 7f9985ffb700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9978063c90 0x7f9978066140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:22.709 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.696+0000 7f9985ffb700 1 -- 172.21.15.160:0/1255976486 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9988080710 con 0x7f99980c41f0 2022-03-21T13:54:22.710 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.696+0000 7f999de28700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9978063c90 0x7f9978066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:22.710 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.696+0000 7f999de28700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9978063c90 0x7f9978066140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9994005ad0 tx=0x7f9994009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:22.710 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.700+0000 7f9985ffb700 1 -- 172.21.15.160:0/1255976486 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f998804f630 con 0x7f99980c41f0 2022-03-21T13:54:22.891 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.891+0000 7f99a008c700 1 -- 172.21.15.160:0/1255976486 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f999805d730 con 0x7f99980c41f0 2022-03-21T13:54:22.892 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.892+0000 7f9985ffb700 1 -- 172.21.15.160:0/1255976486 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13701 (secure 0 0 0) 0x7f9988052c50 con 0x7f99980c41f0 2022-03-21T13:54:22.893 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:22.893 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":15,"fsid":"b2a3ddc8-064e-4cc9-8187-33ea19afd50a","created":"2022-03-21T13:54:10.384226+0000","modified":"2022-03-21T13:54:22.503969+0000","last_up_change":"2022-03-21T13:54:20.412036+0000","last_in_change":"2022-03-21T13:54:12.760084+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-03-21T13:54:21.458770+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-03-21T13:54:21.499620+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"828ac39d-86ad-44a1-bb66-c99786642970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":25441},{"type":"v1","addr":"172.21.15.160:6810","nonce":25441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":25441},{"type":"v1","addr":"172.21.15.160:6814","nonce":25441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":25441},{"type":"v1","addr":"172.21.15.160:6822","nonce":25441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":25441},{"type":"v1","addr":"172.21.15.160:6818","nonce":25441}]},"public_addr":"172.21.15.160:6810/25441","cluster_addr":"172.21.15.160:6814/25441","heartbeat_back_addr":"172.21.15.160:6822/25441","heartbeat_front_addr":"172.21.15.160:6818/25441","state":["exists","up"]},{"osd":1,"uuid":"464764e2-a47e-43c0-8c93-b6bfd10ba526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":25442},{"type":"v1","addr":"172.21.15.160:6825","nonce":25442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":25442},{"type":"v1","addr":"172.21.15.160:6827","nonce":25442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":25442},{"type":"v1","addr":"172.21.15.160:6831","nonce":25442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":25442},{"type":"v1","addr":"172.21.15.160:6829","nonce":25442}]},"public_addr":"172.21.15.160:6825/25442","cluster_addr":"172.21.15.160:6827/25442","heartbeat_back_addr":"172.21.15.160:6831/25442","heartbeat_front_addr":"172.21.15.160:6829/25442","state":["exists","up"]},{"osd":2,"uuid":"4dbfea57-14b6-4c67-8312-fc7d71ef77a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":25443},{"type":"v1","addr":"172.21.15.160:6811","nonce":25443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6813","nonce":25443},{"type":"v1","addr":"172.21.15.160:6815","nonce":25443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":25443},{"type":"v1","addr":"172.21.15.160:6823","nonce":25443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":25443},{"type":"v1","addr":"172.21.15.160:6819","nonce":25443}]},"public_addr":"172.21.15.160:6811/25443","cluster_addr":"172.21.15.160:6815/25443","heartbeat_back_addr":"172.21.15.160:6823/25443","heartbeat_front_addr":"172.21.15.160:6819/25443","state":["exists","up"]},{"osd":3,"uuid":"c53ed58d-a1f3-4783-8677-9348a1d103f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":25440},{"type":"v1","addr":"172.21.15.160:6801","nonce":25440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":25440},{"type":"v1","addr":"172.21.15.160:6803","nonce":25440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":25440},{"type":"v1","addr":"172.21.15.160:6807","nonce":25440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":25440},{"type":"v1","addr":"172.21.15.160:6805","nonce":25440}]},"public_addr":"172.21.15.160:6801/25440","cluster_addr":"172.21.15.160:6803/25440","heartbeat_back_addr":"172.21.15.160:6807/25440","heartbeat_front_addr":"172.21.15.160:6805/25440","state":["exists","up"]},{"osd":4,"uuid":"5713dbd4-1736-4ebf-8102-e80f4db6bcc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":25559},{"type":"v1","addr":"172.21.15.171:6817","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":25559},{"type":"v1","addr":"172.21.15.171:6819","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":25559},{"type":"v1","addr":"172.21.15.171:6826","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":25559},{"type":"v1","addr":"172.21.15.171:6821","nonce":25559}]},"public_addr":"172.21.15.171:6817/25559","cluster_addr":"172.21.15.171:6819/25559","heartbeat_back_addr":"172.21.15.171:6826/25559","heartbeat_front_addr":"172.21.15.171:6821/25559","state":["exists","up"]},{"osd":5,"uuid":"dfe21128-6ae6-4662-9f47-1bbb423a2232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":25549},{"type":"v1","addr":"172.21.15.171:6801","nonce":25549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":25549},{"type":"v1","addr":"172.21.15.171:6803","nonce":25549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":25549},{"type":"v1","addr":"172.21.15.171:6807","nonce":25549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":25549},{"type":"v1","addr":"172.21.15.171:6805","nonce":25549}]},"public_addr":"172.21.15.171:6801/25549","cluster_addr":"172.21.15.171:6803/25549","heartbeat_back_addr":"172.21.15.171:6807/25549","heartbeat_front_addr":"172.21.15.171:6805/25549","state":["exists","up"]},{"osd":6,"uuid":"24a9b956-5fa1-41bf-a689-0f048b7f19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":25574},{"type":"v1","addr":"172.21.15.171:6823","nonce":25574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":25574},{"type":"v1","addr":"172.21.15.171:6827","nonce":25574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":25574},{"type":"v1","addr":"172.21.15.171:6831","nonce":25574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":25574},{"type":"v1","addr":"172.21.15.171:6829","nonce":25574}]},"public_addr":"172.21.15.171:6823/25574","cluster_addr":"172.21.15.171:6827/25574","heartbeat_back_addr":"172.21.15.171:6831/25574","heartbeat_front_addr":"172.21.15.171:6829/25574","state":["exists","up"]},{"osd":7,"uuid":"a5ab4a14-8a7b-43b8-932c-a950f81c10f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":25550},{"type":"v1","addr":"172.21.15.171:6809","nonce":25550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":25550},{"type":"v1","addr":"172.21.15.171:6811","nonce":25550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":25550},{"type":"v1","addr":"172.21.15.171:6815","nonce":25550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":25550},{"type":"v1","addr":"172.21.15.171:6813","nonce":25550}]},"public_addr":"172.21.15.171:6809/25550","cluster_addr":"172.21.15.171:6811/25550","heartbeat_back_addr":"172.21.15.171:6815/25550","heartbeat_front_addr":"172.21.15.171:6813/25550","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.888796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.906098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.896027+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.876694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954695+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.846031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.883631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-21T13:54:22.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 -- 172.21.15.160:0/1255976486 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9978063c90 msgr2=0x7f9978066140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:22.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9978063c90 0x7f9978066140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9994005ad0 tx=0x7f9994009040 comp rx=0 tx=0).stop 2022-03-21T13:54:22.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 -- 172.21.15.160:0/1255976486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99980c41f0 msgr2=0x7f99980b9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:22.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99980c41f0 0x7f99980b9ff0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f998800e930 tx=0x7f9988009060 comp rx=0 tx=0).stop 2022-03-21T13:54:22.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 -- 172.21.15.160:0/1255976486 shutdown_connections 2022-03-21T13:54:22.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9978063c90 0x7f9978066140 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f999815c750 0x7f99980ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99980c3e20 0x7f9998159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 --2- 172.21.15.160:0/1255976486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99980c41f0 0x7f99980b9ff0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:22.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 -- 172.21.15.160:0/1255976486 >> 172.21.15.160:0/1255976486 conn(0x7f99980c87e0 msgr2=0x7f9998155420 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:22.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 -- 172.21.15.160:0/1255976486 shutdown_connections 2022-03-21T13:54:22.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:22.894+0000 7f99a008c700 1 -- 172.21.15.160:0/1255976486 wait complete. 2022-03-21T13:54:22.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-03-21T13:54:21.458770+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2022-03-21T13:54:21.499620+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2022-03-21T13:54:22.907 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-03-21T13:54:23.027 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.026+0000 7fee953ad700 1 Processor -- start 2022-03-21T13:54:23.028 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.026+0000 7fee953ad700 1 -- start start 2022-03-21T13:54:23.030 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.027+0000 7fee953ad700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9006b2e0 0x7fee9006cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.031 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.027+0000 7fee953ad700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fee9006b6b0 0x7fee900c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.031 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.027+0000 7fee953ad700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fee90154ee0 0x7fee900c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.031 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.027+0000 7fee953ad700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee900bed90 con 0x7fee9006b6b0 2022-03-21T13:54:23.031 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.027+0000 7fee953ad700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee900bf890 con 0x7fee90154ee0 2022-03-21T13:54:23.032 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.027+0000 7fee953ad700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9006c720 con 0x7fee9006b2e0 2022-03-21T13:54:23.032 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.027+0000 7fee8e7fc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fee9006b6b0 0x7fee900c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.032 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.027+0000 7fee8e7fc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fee9006b6b0 0x7fee900c14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56092/0 (socket says 172.21.15.160:56092) 2022-03-21T13:54:23.032 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.027+0000 7fee8e7fc700 1 -- 172.21.15.160:0/4102127174 learned_addr learned my addr 172.21.15.160:0/4102127174 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:23.033 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee8f7fe700 1 --2- 172.21.15.160:0/4102127174 >> v2:172.21.15.171:3300/0 conn(0x7fee90154ee0 0x7fee900c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.033 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee8effd700 1 --2- 172.21.15.160:0/4102127174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9006b2e0 0x7fee9006cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.033 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee8e7fc700 1 -- 172.21.15.160:0/4102127174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9006b2e0 msgr2=0x7fee9006cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:23.033 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee8e7fc700 1 --2- 172.21.15.160:0/4102127174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9006b2e0 0x7fee9006cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.034 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee8e7fc700 1 -- 172.21.15.160:0/4102127174 >> v2:172.21.15.171:3300/0 conn(0x7fee90154ee0 msgr2=0x7fee900c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:23.034 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee8e7fc700 1 --2- 172.21.15.160:0/4102127174 >> v2:172.21.15.171:3300/0 conn(0x7fee90154ee0 0x7fee900c2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.034 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee8e7fc700 1 -- 172.21.15.160:0/4102127174 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9006c110 con 0x7fee9006b6b0 2022-03-21T13:54:23.034 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee8e7fc700 1 --2- 172.21.15.160:0/4102127174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee9006b6b0 0x7fee900c14a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fee900c2920 tx=0x7fee840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03e3bf3caaef919 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:23.034 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee8dffb700 1 -- 172.21.15.160:0/4102127174 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84004030 con 0x7fee9006b6b0 2022-03-21T13:54:23.035 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee8dffb700 1 -- 172.21.15.160:0/4102127174 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee84004190 con 0x7fee9006b6b0 2022-03-21T13:54:23.035 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee8dffb700 1 -- 172.21.15.160:0/4102127174 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84011630 con 0x7fee9006b6b0 2022-03-21T13:54:23.035 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee953ad700 1 -- 172.21.15.160:0/4102127174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee9006b6b0 msgr2=0x7fee900c14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.035 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee953ad700 1 --2- 172.21.15.160:0/4102127174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee9006b6b0 0x7fee900c14a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fee900c2920 tx=0x7fee840090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.036 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee953ad700 1 -- 172.21.15.160:0/4102127174 shutdown_connections 2022-03-21T13:54:23.036 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee953ad700 1 --2- 172.21.15.160:0/4102127174 >> v2:172.21.15.171:3300/0 conn(0x7fee90154ee0 0x7fee900c2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.036 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee953ad700 1 --2- 172.21.15.160:0/4102127174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9006b2e0 0x7fee9006cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.036 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.028+0000 7fee953ad700 1 --2- 172.21.15.160:0/4102127174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee9006b6b0 0x7fee900c14a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.036 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.029+0000 7fee953ad700 1 -- 172.21.15.160:0/4102127174 >> 172.21.15.160:0/4102127174 conn(0x7fee90068650 msgr2=0x7fee900c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:23.037 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.029+0000 7fee953ad700 1 -- 172.21.15.160:0/4102127174 shutdown_connections 2022-03-21T13:54:23.037 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.029+0000 7fee953ad700 1 -- 172.21.15.160:0/4102127174 wait complete. 2022-03-21T13:54:23.037 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.030+0000 7fee953ad700 1 Processor -- start 2022-03-21T13:54:23.037 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.030+0000 7fee953ad700 1 -- start start 2022-03-21T13:54:23.040 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.030+0000 7fee953ad700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee9006b2e0 0x7fee90166bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.041 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.030+0000 7fee953ad700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9006b6b0 0x7fee901544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.041 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.030+0000 7fee953ad700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee90154ee0 0x7fee900a61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.041 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.030+0000 7fee953ad700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee900a89b0 con 0x7fee90154ee0 2022-03-21T13:54:23.041 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.030+0000 7fee953ad700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee900a5260 con 0x7fee9006b2e0 2022-03-21T13:54:23.041 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.030+0000 7fee953ad700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee90162bd0 con 0x7fee9006b6b0 2022-03-21T13:54:23.042 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee8f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee90154ee0 0x7fee900a61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.042 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee8f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee90154ee0 0x7fee900a61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56100/0 (socket says 172.21.15.160:56100) 2022-03-21T13:54:23.042 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee8f7fe700 1 -- 172.21.15.160:0/3711829208 learned_addr learned my addr 172.21.15.160:0/3711829208 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:23.042 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee8effd700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee9006b2e0 0x7fee90166bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.043 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee8e7fc700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9006b6b0 0x7fee901544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.043 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee8f7fe700 1 -- 172.21.15.160:0/3711829208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9006b6b0 msgr2=0x7fee901544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.043 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee8f7fe700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9006b6b0 0x7fee901544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.043 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee8f7fe700 1 -- 172.21.15.160:0/3711829208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee9006b2e0 msgr2=0x7fee90166bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.043 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee8f7fe700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee9006b2e0 0x7fee90166bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.044 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee8f7fe700 1 -- 172.21.15.160:0/3711829208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84009370 con 0x7fee90154ee0 2022-03-21T13:54:23.044 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee8f7fe700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee90154ee0 0x7fee900a61a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee88007f20 tx=0x7fee88009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:23.044 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee76ffd700 1 -- 172.21.15.160:0/3711829208 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800eb90 con 0x7fee90154ee0 2022-03-21T13:54:23.044 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee76ffd700 1 -- 172.21.15.160:0/3711829208 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8800ed10 con 0x7fee90154ee0 2022-03-21T13:54:23.045 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee953ad700 1 -- 172.21.15.160:0/3711829208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee90163710 con 0x7fee90154ee0 2022-03-21T13:54:23.045 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee76ffd700 1 -- 172.21.15.160:0/3711829208 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88014670 con 0x7fee90154ee0 2022-03-21T13:54:23.045 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.031+0000 7fee953ad700 1 -- 172.21.15.160:0/3711829208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee900a4f80 con 0x7fee90154ee0 2022-03-21T13:54:23.045 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.032+0000 7fee953ad700 1 -- 172.21.15.160:0/3711829208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee901638a0 con 0x7fee90154ee0 2022-03-21T13:54:23.045 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.032+0000 7fee76ffd700 1 -- 172.21.15.160:0/3711829208 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 4) v1 ==== 81882+0+0 (secure 0 0 0) 0x7fee88012050 con 0x7fee90154ee0 2022-03-21T13:54:23.046 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.033+0000 7fee76ffd700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee70063c90 0x7fee70066140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.046 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.033+0000 7fee76ffd700 1 -- 172.21.15.160:0/3711829208 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fee880808f0 con 0x7fee90154ee0 2022-03-21T13:54:23.046 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.037+0000 7fee76ffd700 1 -- 172.21.15.160:0/3711829208 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fee8804f810 con 0x7fee90154ee0 2022-03-21T13:54:23.046 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.039+0000 7fee8effd700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee70063c90 0x7fee70066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.047 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.039+0000 7fee8effd700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee70063c90 0x7fee70066140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee80003760 tx=0x7fee80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:23.213 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.212+0000 7fee953ad700 1 -- 172.21.15.160:0/3711829208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fee90070ae0 con 0x7fee90154ee0 2022-03-21T13:54:23.214 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.213+0000 7fee76ffd700 1 -- 172.21.15.160:0/3711829208 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7fee88052e30 con 0x7fee90154ee0 2022-03-21T13:54:23.214 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2022-03-21T13:54:23.216 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 -- 172.21.15.160:0/3711829208 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee70063c90 msgr2=0x7fee70066140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.216 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee70063c90 0x7fee70066140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee80003760 tx=0x7fee80008040 comp rx=0 tx=0).stop 2022-03-21T13:54:23.216 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 -- 172.21.15.160:0/3711829208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee90154ee0 msgr2=0x7fee900a61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.216 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee90154ee0 0x7fee900a61a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee88007f20 tx=0x7fee88009860 comp rx=0 tx=0).stop 2022-03-21T13:54:23.217 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 -- 172.21.15.160:0/3711829208 shutdown_connections 2022-03-21T13:54:23.217 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee70063c90 0x7fee70066140 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.217 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee90154ee0 0x7fee900a61a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.217 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee9006b2e0 0x7fee90166bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.218 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 --2- 172.21.15.160:0/3711829208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9006b6b0 0x7fee901544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.218 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 -- 172.21.15.160:0/3711829208 >> 172.21.15.160:0/3711829208 conn(0x7fee90068650 msgr2=0x7fee900c5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:23.218 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 -- 172.21.15.160:0/3711829208 shutdown_connections 2022-03-21T13:54:23.219 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.215+0000 7fee953ad700 1 -- 172.21.15.160:0/3711829208 wait complete. 2022-03-21T13:54:23.227 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-03-21T13:54:23.343 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.343+0000 7f0eb5d52700 1 Processor -- start 2022-03-21T13:54:23.344 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.343+0000 7f0eb5d52700 1 -- start start 2022-03-21T13:54:23.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.343+0000 7f0eb5d52700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb00c7230 0x7f0eb006a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.343+0000 7f0eb5d52700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb0159170 con 0x7f0eb006ad30 2022-03-21T13:54:23.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.343+0000 7f0eb5d52700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb006db10 con 0x7f0eb006d740 2022-03-21T13:54:23.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.343+0000 7f0eb5d52700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb0158280 con 0x7f0eb00c7230 2022-03-21T13:54:23.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.344+0000 7f0eaffff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb00c7230 0x7f0eb006a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.344+0000 7f0eb4d50700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f0eb006d740 0x7f0eb00c5720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:52352/0 (socket says 172.21.15.160:52352) 2022-03-21T13:54:23.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.344+0000 7f0eb4d50700 1 -- 172.21.15.160:0/3206345943 learned_addr learned my addr 172.21.15.160:0/3206345943 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:23.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.344+0000 7f0eaffff700 1 -- 172.21.15.160:0/3206345943 >> v1:172.21.15.171:6789/0 conn(0x7f0eb006d740 legacy=0x7f0eb00c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.344+0000 7f0eaf7fe700 1 -- 172.21.15.160:0/3206345943 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626428811 0 0) 0x7f0eb006db10 con 0x7f0eb006d740 2022-03-21T13:54:23.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.344+0000 7f0eaffff700 1 -- 172.21.15.160:0/3206345943 >> v1:172.21.15.160:6789/0 conn(0x7f0eb006ad30 legacy=0x7f0eb006c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.344+0000 7f0eaffff700 1 -- 172.21.15.160:0/3206345943 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0158560 con 0x7f0eb00c7230 2022-03-21T13:54:23.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.344+0000 7f0eaffff700 1 --2- 172.21.15.160:0/3206345943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb00c7230 0x7f0eb006a7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009790 tx=0x7f0e9c009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b3ba86066697193 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:23.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.344+0000 7f0eaf7fe700 1 -- 172.21.15.160:0/3206345943 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c011630 con 0x7f0eb00c7230 2022-03-21T13:54:23.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.344+0000 7f0eaf7fe700 1 -- 172.21.15.160:0/3206345943 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c011790 con 0x7f0eb00c7230 2022-03-21T13:54:23.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.344+0000 7f0eaf7fe700 1 -- 172.21.15.160:0/3206345943 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c011b30 con 0x7f0eb00c7230 2022-03-21T13:54:23.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.345+0000 7f0eb5d52700 1 -- 172.21.15.160:0/3206345943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb00c7230 msgr2=0x7f0eb006a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.345+0000 7f0eb5d52700 1 --2- 172.21.15.160:0/3206345943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb00c7230 0x7f0eb006a7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009790 tx=0x7f0e9c009060 comp rx=0 tx=0).stop 2022-03-21T13:54:23.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.345+0000 7f0eb5d52700 1 -- 172.21.15.160:0/3206345943 shutdown_connections 2022-03-21T13:54:23.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.345+0000 7f0eb5d52700 1 --2- 172.21.15.160:0/3206345943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb00c7230 0x7f0eb006a7f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.345+0000 7f0eb5d52700 1 -- 172.21.15.160:0/3206345943 >> 172.21.15.160:0/3206345943 conn(0x7f0eb00c7910 msgr2=0x7f0eb00c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:23.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.345+0000 7f0eb5d52700 1 -- 172.21.15.160:0/3206345943 shutdown_connections 2022-03-21T13:54:23.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.345+0000 7f0eb5d52700 1 -- 172.21.15.160:0/3206345943 wait complete. 2022-03-21T13:54:23.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.346+0000 7f0eb5d52700 1 Processor -- start 2022-03-21T13:54:23.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.346+0000 7f0eb5d52700 1 -- start start 2022-03-21T13:54:23.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eb5d52700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eb006ad30 0x7f0eb00be070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eb5d52700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb006d740 0x7f0eb00bb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eb5d52700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0eb00c7230 0x7f0eb00c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eb5d52700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00c3e50 con 0x7f0eb00c7230 2022-03-21T13:54:23.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eb5d52700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00be5b0 con 0x7f0eb006ad30 2022-03-21T13:54:23.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eb5d52700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb0155cd0 con 0x7f0eb006d740 2022-03-21T13:54:23.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eb5551700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0eb00c7230 0x7f0eb00c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eb5551700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0eb00c7230 0x7f0eb00c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56122/0 (socket says 172.21.15.160:56122) 2022-03-21T13:54:23.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eb5551700 1 -- 172.21.15.160:0/1660433126 learned_addr learned my addr 172.21.15.160:0/1660433126 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:23.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eb4d50700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eb006ad30 0x7f0eb00be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eaffff700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb006d740 0x7f0eb00bb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eaffff700 1 -- 172.21.15.160:0/1660433126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eb006ad30 msgr2=0x7f0eb00be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.359 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eaffff700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eb006ad30 0x7f0eb00be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.359 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eaffff700 1 -- 172.21.15.160:0/1660433126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0eb00c7230 msgr2=0x7f0eb00c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.359 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eaffff700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0eb00c7230 0x7f0eb00c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.359 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eaffff700 1 -- 172.21.15.160:0/1660433126 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c0092a0 con 0x7f0eb006d740 2022-03-21T13:54:23.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eb4d50700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eb006ad30 0x7f0eb00be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:23.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.347+0000 7f0eaffff700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb006d740 0x7f0eb00bb700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c016000 tx=0x7f0e9c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:23.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.348+0000 7f0eacff9700 1 -- 172.21.15.160:0/1660433126 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c01f070 con 0x7f0eb006d740 2022-03-21T13:54:23.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.348+0000 7f0eacff9700 1 -- 172.21.15.160:0/1660433126 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c000bc0 con 0x7f0eb006d740 2022-03-21T13:54:23.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.348+0000 7f0eb5d52700 1 -- 172.21.15.160:0/1660433126 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb00c3520 con 0x7f0eb006d740 2022-03-21T13:54:23.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.348+0000 7f0eacff9700 1 -- 172.21.15.160:0/1660433126 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c025420 con 0x7f0eb006d740 2022-03-21T13:54:23.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.348+0000 7f0eb5d52700 1 -- 172.21.15.160:0/1660433126 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb00c3ae0 con 0x7f0eb006d740 2022-03-21T13:54:23.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.349+0000 7f0eb5d52700 1 -- 172.21.15.160:0/1660433126 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb004b760 con 0x7f0eb006d740 2022-03-21T13:54:23.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.349+0000 7f0eacff9700 1 -- 172.21.15.160:0/1660433126 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 4) v1 ==== 81882+0+0 (secure 0 0 0) 0x7f0e9c02c030 con 0x7f0eb006d740 2022-03-21T13:54:23.362 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.349+0000 7f0eacff9700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0e98063cc0 0x7f0e98066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.362 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.349+0000 7f0eacff9700 1 -- 172.21.15.160:0/1660433126 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0e9c0819d0 con 0x7f0eb006d740 2022-03-21T13:54:23.362 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.349+0000 7f0eb4d50700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0e98063cc0 0x7f0e98066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.362 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.350+0000 7f0eb4d50700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0e98063cc0 0x7f0e98066170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40011e0 tx=0x7f0ea4007bb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:23.363 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.354+0000 7f0eacff9700 1 -- 172.21.15.160:0/1660433126 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f0e9c050860 con 0x7f0eb006d740 2022-03-21T13:54:23.531 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.530+0000 7f0eb5d52700 1 -- 172.21.15.160:0/1660433126 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0eb00c5fc0 con 0x7f0eb006d740 2022-03-21T13:54:23.548 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.547+0000 7f0eacff9700 1 -- 172.21.15.160:0/1660433126 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e9c02a020 con 0x7f0eb006d740 2022-03-21T13:54:23.548 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 1 2022-03-21T13:54:23.551 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 -- 172.21.15.160:0/1660433126 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0e98063cc0 msgr2=0x7f0e98066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.551 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0e98063cc0 0x7f0e98066170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40011e0 tx=0x7f0ea4007bb0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.551 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 -- 172.21.15.160:0/1660433126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb006d740 msgr2=0x7f0eb00bb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb006d740 0x7f0eb00bb700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c016000 tx=0x7f0e9c014000 comp rx=0 tx=0).stop 2022-03-21T13:54:23.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 -- 172.21.15.160:0/1660433126 shutdown_connections 2022-03-21T13:54:23.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0e98063cc0 0x7f0e98066170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0eb00c7230 0x7f0eb00c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eb006ad30 0x7f0eb00be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 --2- 172.21.15.160:0/1660433126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eb006d740 0x7f0eb00bb700 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 -- 172.21.15.160:0/1660433126 >> 172.21.15.160:0/1660433126 conn(0x7f0eb00c7910 msgr2=0x7f0eb00c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:23.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 -- 172.21.15.160:0/1660433126 shutdown_connections 2022-03-21T13:54:23.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.550+0000 7f0eb5d52700 1 -- 172.21.15.160:0/1660433126 wait complete. 2022-03-21T13:54:23.563 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-03-21T13:54:23.679 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.678+0000 7efd4bc88700 1 Processor -- start 2022-03-21T13:54:23.679 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.678+0000 7efd4bc88700 1 -- start start 2022-03-21T13:54:23.686 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.679+0000 7efd4bc88700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efd4414ec50 0x7efd440c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.686 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.679+0000 7efd4bc88700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd440c53e0 0x7efd4414f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.686 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.679+0000 7efd4bc88700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd44067ab0 con 0x7efd4406c070 2022-03-21T13:54:23.687 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.679+0000 7efd4bc88700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd440c32c0 con 0x7efd4414ec50 2022-03-21T13:54:23.687 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.679+0000 7efd4bc88700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd440c3a20 con 0x7efd440c53e0 2022-03-21T13:54:23.687 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.679+0000 7efd4a225700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7efd4406c070 0x7efd44158210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59290/0 (socket says 172.21.15.160:59290) 2022-03-21T13:54:23.687 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.679+0000 7efd4a225700 1 -- 172.21.15.160:0/2927536931 learned_addr learned my addr 172.21.15.160:0/2927536931 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:23.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.679+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864030308 0 0) 0x7efd44067ab0 con 0x7efd4406c070 2022-03-21T13:54:23.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.679+0000 7efd49a24700 1 --2- 172.21.15.160:0/2927536931 >> v2:172.21.15.171:3300/0 conn(0x7efd4414ec50 0x7efd440c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.679+0000 7efd49223700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd440c53e0 0x7efd4414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.679+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd2c0033f0 con 0x7efd4406c070 2022-03-21T13:54:23.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2676887218 0 0) 0x7efd2c0033f0 con 0x7efd4406c070 2022-03-21T13:54:23.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd440c53e0 msgr2=0x7efd4414f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:23.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd440c53e0 0x7efd4414f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 >> v2:172.21.15.171:3300/0 conn(0x7efd4414ec50 msgr2=0x7efd440c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:23.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 --2- 172.21.15.160:0/2927536931 >> v2:172.21.15.171:3300/0 conn(0x7efd4414ec50 0x7efd440c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd440677d0 con 0x7efd4406c070 2022-03-21T13:54:23.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7efd3c0017f0 con 0x7efd4406c070 2022-03-21T13:54:23.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 >> v1:172.21.15.160:6789/0 conn(0x7efd4406c070 legacy=0x7efd44158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd2c0038e0 0x7efd2c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c004690 0x7efd2c004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd440c53e0 0x7efd2c005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd440c32c0 con 0x7efd2c004690 2022-03-21T13:54:23.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd440c3a20 con 0x7efd2c0038e0 2022-03-21T13:54:23.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c00b960 con 0x7efd440c53e0 2022-03-21T13:54:23.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd49223700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c004690 0x7efd2c004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd49a24700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd2c0038e0 0x7efd2c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd4a225700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd440c53e0 0x7efd2c005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd49a24700 1 -- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd440c53e0 msgr2=0x7efd2c005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:23.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd49a24700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd440c53e0 0x7efd2c005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd49a24700 1 -- 172.21.15.160:0/2927536931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c004690 msgr2=0x7efd2c004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:23.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd49a24700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c004690 0x7efd2c004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd49a24700 1 -- 172.21.15.160:0/2927536931 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c0033f0 con 0x7efd2c0038e0 2022-03-21T13:54:23.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd49223700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c004690 0x7efd2c004b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:23.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd49a24700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd2c0038e0 0x7efd2c003cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd40009ab0 tx=0x7efd40009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=185a488c3d3938bf server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:23.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40009430 con 0x7efd2c0038e0 2022-03-21T13:54:23.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4000e640 con 0x7efd2c0038e0 2022-03-21T13:54:23.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.680+0000 7efd48a22700 1 -- 172.21.15.160:0/2927536931 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4000ea00 con 0x7efd2c0038e0 2022-03-21T13:54:23.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.681+0000 7efd4bc88700 1 -- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd2c0038e0 msgr2=0x7efd2c003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.681+0000 7efd4bc88700 1 --2- 172.21.15.160:0/2927536931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd2c0038e0 0x7efd2c003cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd40009ab0 tx=0x7efd40009060 comp rx=0 tx=0).stop 2022-03-21T13:54:23.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.681+0000 7efd4a225700 1 -- 172.21.15.160:0/2927536931 reap_dead start 2022-03-21T13:54:23.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.681+0000 7efd4bc88700 1 -- 172.21.15.160:0/2927536931 shutdown_connections 2022-03-21T13:54:23.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.681+0000 7efd4bc88700 1 -- 172.21.15.160:0/2927536931 >> 172.21.15.160:0/2927536931 conn(0x7efd440c98f0 msgr2=0x7efd440c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:23.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.681+0000 7efd4bc88700 1 -- 172.21.15.160:0/2927536931 shutdown_connections 2022-03-21T13:54:23.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.681+0000 7efd4bc88700 1 -- 172.21.15.160:0/2927536931 wait complete. 2022-03-21T13:54:23.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.682+0000 7efd4bc88700 1 Processor -- start 2022-03-21T13:54:23.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.682+0000 7efd4bc88700 1 -- start start 2022-03-21T13:54:23.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd4bc88700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c0038e0 0x7efd440bde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd4bc88700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd44157b70 0x7efd44156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd4bc88700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd441565b0 0x7efd44167950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd4bc88700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd44155920 con 0x7efd2c0038e0 2022-03-21T13:54:23.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd4bc88700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd440a95c0 con 0x7efd441565b0 2022-03-21T13:54:23.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd4bc88700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd440aa0e0 con 0x7efd44157b70 2022-03-21T13:54:23.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd49a24700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c0038e0 0x7efd440bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd49a24700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c0038e0 0x7efd440bde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56146/0 (socket says 172.21.15.160:56146) 2022-03-21T13:54:23.699 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd49a24700 1 -- 172.21.15.160:0/905378262 learned_addr learned my addr 172.21.15.160:0/905378262 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:23.699 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd4a225700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd441565b0 0x7efd44167950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.699 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd49223700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd44157b70 0x7efd44156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.699 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd49a24700 1 -- 172.21.15.160:0/905378262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd44157b70 msgr2=0x7efd44156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.699 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd49a24700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd44157b70 0x7efd44156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.700 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd49a24700 1 -- 172.21.15.160:0/905378262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd441565b0 msgr2=0x7efd44167950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.700 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd49a24700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd441565b0 0x7efd44167950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.700 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd49a24700 1 -- 172.21.15.160:0/905378262 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44156a00 con 0x7efd2c0038e0 2022-03-21T13:54:23.700 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd4a225700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd441565b0 0x7efd44167950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:23.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd49223700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd44157b70 0x7efd44156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:23.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd49a24700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c0038e0 0x7efd440bde60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd40006d50 tx=0x7efd4001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:23.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd31ffb700 1 -- 172.21.15.160:0/905378262 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40022070 con 0x7efd2c0038e0 2022-03-21T13:54:23.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd31ffb700 1 -- 172.21.15.160:0/905378262 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4000e980 con 0x7efd2c0038e0 2022-03-21T13:54:23.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd4bc88700 1 -- 172.21.15.160:0/905378262 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd44155640 con 0x7efd2c0038e0 2022-03-21T13:54:23.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.683+0000 7efd31ffb700 1 -- 172.21.15.160:0/905378262 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40003920 con 0x7efd2c0038e0 2022-03-21T13:54:23.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.684+0000 7efd4bc88700 1 -- 172.21.15.160:0/905378262 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd440a9a90 con 0x7efd2c0038e0 2022-03-21T13:54:23.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.685+0000 7efd4bc88700 1 -- 172.21.15.160:0/905378262 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4406fc00 con 0x7efd2c0038e0 2022-03-21T13:54:23.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.685+0000 7efd31ffb700 1 -- 172.21.15.160:0/905378262 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 4) v1 ==== 81882+0+0 (secure 0 0 0) 0x7efd4002e030 con 0x7efd2c0038e0 2022-03-21T13:54:23.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.685+0000 7efd31ffb700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7efd24063cc0 0x7efd24066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:23.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.685+0000 7efd31ffb700 1 -- 172.21.15.160:0/905378262 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7efd40081c80 con 0x7efd2c0038e0 2022-03-21T13:54:23.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.685+0000 7efd49223700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7efd24063cc0 0x7efd24066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:23.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.686+0000 7efd49223700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7efd24063cc0 0x7efd24066170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efd34004520 tx=0x7efd34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:23.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.690+0000 7efd31ffb700 1 -- 172.21.15.160:0/905378262 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7efd40050c00 con 0x7efd2c0038e0 2022-03-21T13:54:23.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.900+0000 7efd4bc88700 1 -- 172.21.15.160:0/905378262 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd440c4620 con 0x7efd2c0038e0 2022-03-21T13:54:23.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.901+0000 7efd31ffb700 1 -- 172.21.15.160:0/905378262 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5048 (secure 0 0 0) 0x7efd4002c020 con 0x7efd2c0038e0 2022-03-21T13:54:23.902 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:23.902 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1715710880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1715710880},{"type":"v1","addr":"172.21.15.160:6835","nonce":1715710880}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/307954587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":307954587},{"type":"v1","addr":"172.21.15.171:6833","nonce":307954587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3534006535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3534006535},{"type":"v1","addr":"172.21.15.160:6837","nonce":3534006535}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/826342148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":826342148},{"type":"v1","addr":"172.21.15.171:6835","nonce":826342148}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/4108285334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":4108285334},{"type":"v1","addr":"172.21.15.160:6839","nonce":4108285334}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/4225939003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4225939003},{"type":"v1","addr":"172.21.15.171:6837","nonce":4225939003}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-03-21T13:54:23.904 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 -- 172.21.15.160:0/905378262 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7efd24063cc0 msgr2=0x7efd24066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.904 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7efd24063cc0 0x7efd24066170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efd34004520 tx=0x7efd34008040 comp rx=0 tx=0).stop 2022-03-21T13:54:23.904 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 -- 172.21.15.160:0/905378262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c0038e0 msgr2=0x7efd440bde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:23.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c0038e0 0x7efd440bde60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd40006d50 tx=0x7efd4001a000 comp rx=0 tx=0).stop 2022-03-21T13:54:23.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 -- 172.21.15.160:0/905378262 shutdown_connections 2022-03-21T13:54:23.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7efd24063cc0 0x7efd24066170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd441565b0 0x7efd44167950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd2c0038e0 0x7efd440bde60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 --2- 172.21.15.160:0/905378262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd44157b70 0x7efd44156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:23.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 -- 172.21.15.160:0/905378262 >> 172.21.15.160:0/905378262 conn(0x7efd440c98f0 msgr2=0x7efd440c0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:23.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 -- 172.21.15.160:0/905378262 shutdown_connections 2022-03-21T13:54:23.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:23.903+0000 7efd4bc88700 1 -- 172.21.15.160:0/905378262 wait complete. 2022-03-21T13:54:23.907 INFO:teuthology.orchestra.run.smithi160.stderr:dumped fsmap epoch 3 2022-03-21T13:54:23.916 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-21T13:54:24.031 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.028+0000 7fb857fff700 1 Processor -- start 2022-03-21T13:54:24.031 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.028+0000 7fb857fff700 1 -- start start 2022-03-21T13:54:24.032 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb857fff700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb85806c1c0 0x7fb8580c0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.032 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb857fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb85814ce20 0x7fb8580c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.032 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb857fff700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85806d910 con 0x7fb85814ca50 2022-03-21T13:54:24.032 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb857fff700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8580c4f50 con 0x7fb85814ce20 2022-03-21T13:54:24.033 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb857fff700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85806ded0 con 0x7fb85806c1c0 2022-03-21T13:54:24.033 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb8577fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb85814ce20 0x7fb8580c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.033 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb8577fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb85814ce20 0x7fb8580c08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56158/0 (socket says 172.21.15.160:56158) 2022-03-21T13:54:24.033 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb8577fe700 1 -- 172.21.15.160:0/1525479442 learned_addr learned my addr 172.21.15.160:0/1525479442 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:24.033 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb856ffd700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fb85814ca50 0x7fb85806cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59306/0 (socket says 172.21.15.160:59306) 2022-03-21T13:54:24.034 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb8567fc700 1 --2- 172.21.15.160:0/1525479442 >> v2:172.21.15.171:3300/0 conn(0x7fb85806c1c0 0x7fb8580c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.034 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb8577fe700 1 -- 172.21.15.160:0/1525479442 >> v2:172.21.15.171:3300/0 conn(0x7fb85806c1c0 msgr2=0x7fb8580c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:24.034 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb8577fe700 1 --2- 172.21.15.160:0/1525479442 >> v2:172.21.15.171:3300/0 conn(0x7fb85806c1c0 0x7fb8580c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.034 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb8577fe700 1 -- 172.21.15.160:0/1525479442 >> v1:172.21.15.160:6789/0 conn(0x7fb85814ca50 legacy=0x7fb85806cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.035 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb855ffb700 1 -- 172.21.15.160:0/1525479442 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344283401 0 0) 0x7fb85806d910 con 0x7fb85814ca50 2022-03-21T13:54:24.035 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb8577fe700 1 -- 172.21.15.160:0/1525479442 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580c2b80 con 0x7fb85814ce20 2022-03-21T13:54:24.035 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb8577fe700 1 --2- 172.21.15.160:0/1525479442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb85814ce20 0x7fb8580c08d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8580c6430 tx=0x7fb8480090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19027cf980ac27ed server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.035 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb855ffb700 1 -- 172.21.15.160:0/1525479442 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848004030 con 0x7fb85814ce20 2022-03-21T13:54:24.036 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb855ffb700 1 -- 172.21.15.160:0/1525479442 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8480041d0 con 0x7fb85814ce20 2022-03-21T13:54:24.036 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.029+0000 7fb855ffb700 1 -- 172.21.15.160:0/1525479442 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848011630 con 0x7fb85814ce20 2022-03-21T13:54:24.036 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.030+0000 7fb857fff700 1 -- 172.21.15.160:0/1525479442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb85814ce20 msgr2=0x7fb8580c08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.036 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.030+0000 7fb857fff700 1 --2- 172.21.15.160:0/1525479442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb85814ce20 0x7fb8580c08d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8580c6430 tx=0x7fb8480090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.036 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.030+0000 7fb857fff700 1 -- 172.21.15.160:0/1525479442 shutdown_connections 2022-03-21T13:54:24.037 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.030+0000 7fb857fff700 1 --2- 172.21.15.160:0/1525479442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb85814ce20 0x7fb8580c08d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.037 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.030+0000 7fb857fff700 1 --2- 172.21.15.160:0/1525479442 >> v2:172.21.15.171:3300/0 conn(0x7fb85806c1c0 0x7fb8580c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.037 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.030+0000 7fb857fff700 1 -- 172.21.15.160:0/1525479442 >> 172.21.15.160:0/1525479442 conn(0x7fb8580c9710 msgr2=0x7fb8580c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:24.037 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.030+0000 7fb857fff700 1 -- 172.21.15.160:0/1525479442 shutdown_connections 2022-03-21T13:54:24.037 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.030+0000 7fb857fff700 1 -- 172.21.15.160:0/1525479442 wait complete. 2022-03-21T13:54:24.041 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.031+0000 7fb857fff700 1 Processor -- start 2022-03-21T13:54:24.041 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.031+0000 7fb857fff700 1 -- start start 2022-03-21T13:54:24.041 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb857fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb85806c1c0 0x7fb85814f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.041 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb857fff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb85814ca50 0x7fb858162cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.041 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb857fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb85814ce20 0x7fb8581636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.042 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb857fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85814ebc0 con 0x7fb85806c1c0 2022-03-21T13:54:24.042 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb857fff700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85814fbe0 con 0x7fb85814ce20 2022-03-21T13:54:24.042 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb857fff700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85814fe80 con 0x7fb85814ca50 2022-03-21T13:54:24.042 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb856ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb85806c1c0 0x7fb85814f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.043 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb856ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb85806c1c0 0x7fb85814f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56160/0 (socket says 172.21.15.160:56160) 2022-03-21T13:54:24.043 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb856ffd700 1 -- 172.21.15.160:0/2115426548 learned_addr learned my addr 172.21.15.160:0/2115426548 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:24.043 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb8567fc700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb85814ca50 0x7fb858162cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.043 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb8577fe700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb85814ce20 0x7fb8581636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.043 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb856ffd700 1 -- 172.21.15.160:0/2115426548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb85814ca50 msgr2=0x7fb858162cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.044 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb856ffd700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb85814ca50 0x7fb858162cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.044 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb856ffd700 1 -- 172.21.15.160:0/2115426548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb85814ce20 msgr2=0x7fb8581636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.044 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb856ffd700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb85814ce20 0x7fb8581636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.044 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb856ffd700 1 -- 172.21.15.160:0/2115426548 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848009370 con 0x7fb85806c1c0 2022-03-21T13:54:24.045 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb8577fe700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb85814ce20 0x7fb8581636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:54:24.045 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.032+0000 7fb8567fc700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb85814ca50 0x7fb858162cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:54:24.045 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.033+0000 7fb856ffd700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb85806c1c0 0x7fb85814f050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb850007fd0 tx=0x7fb850007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.045 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.033+0000 7fb83effd700 1 -- 172.21.15.160:0/2115426548 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850005c00 con 0x7fb85806c1c0 2022-03-21T13:54:24.045 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.033+0000 7fb83effd700 1 -- 172.21.15.160:0/2115426548 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb850005d60 con 0x7fb85806c1c0 2022-03-21T13:54:24.046 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.033+0000 7fb857fff700 1 -- 172.21.15.160:0/2115426548 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb858150160 con 0x7fb85806c1c0 2022-03-21T13:54:24.046 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.033+0000 7fb83effd700 1 -- 172.21.15.160:0/2115426548 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850007340 con 0x7fb85806c1c0 2022-03-21T13:54:24.046 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.033+0000 7fb857fff700 1 -- 172.21.15.160:0/2115426548 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85814e850 con 0x7fb85806c1c0 2022-03-21T13:54:24.046 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.034+0000 7fb857fff700 1 -- 172.21.15.160:0/2115426548 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85814eea0 con 0x7fb85806c1c0 2022-03-21T13:54:24.047 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.034+0000 7fb83effd700 1 -- 172.21.15.160:0/2115426548 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 4) v1 ==== 81882+0+0 (secure 0 0 0) 0x7fb850010070 con 0x7fb85806c1c0 2022-03-21T13:54:24.047 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.034+0000 7fb83effd700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb838063c90 0x7fb838066140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.047 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.034+0000 7fb83effd700 1 -- 172.21.15.160:0/2115426548 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb850080150 con 0x7fb85806c1c0 2022-03-21T13:54:24.047 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.034+0000 7fb8567fc700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb838063c90 0x7fb838066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.047 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.035+0000 7fb8567fc700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb838063c90 0x7fb838066140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb858154680 tx=0x7fb84c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.048 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.038+0000 7fb83effd700 1 -- 172.21.15.160:0/2115426548 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fb85004f060 con 0x7fb85806c1c0 2022-03-21T13:54:24.130 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.130+0000 7fb83effd700 1 -- 172.21.15.160:0/2115426548 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fb850007730 con 0x7fb85806c1c0 2022-03-21T13:54:24.215 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.214+0000 7fb857fff700 1 -- 172.21.15.160:0/2115426548 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb85806fec0 con 0x7fb85806c1c0 2022-03-21T13:54:24.216 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.215+0000 7fb83effd700 1 -- 172.21.15.160:0/2115426548 <== mon.0 v2:172.21.15.160:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13675 (secure 0 0 0) 0x7fb850052a90 con 0x7fb85806c1c0 2022-03-21T13:54:24.216 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:24.216 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":16,"fsid":"b2a3ddc8-064e-4cc9-8187-33ea19afd50a","created":"2022-03-21T13:54:10.384226+0000","modified":"2022-03-21T13:54:23.509743+0000","last_up_change":"2022-03-21T13:54:20.412036+0000","last_in_change":"2022-03-21T13:54:12.760084+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-03-21T13:54:21.458770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-03-21T13:54:21.499620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"828ac39d-86ad-44a1-bb66-c99786642970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":25441},{"type":"v1","addr":"172.21.15.160:6810","nonce":25441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":25441},{"type":"v1","addr":"172.21.15.160:6814","nonce":25441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":25441},{"type":"v1","addr":"172.21.15.160:6822","nonce":25441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":25441},{"type":"v1","addr":"172.21.15.160:6818","nonce":25441}]},"public_addr":"172.21.15.160:6810/25441","cluster_addr":"172.21.15.160:6814/25441","heartbeat_back_addr":"172.21.15.160:6822/25441","heartbeat_front_addr":"172.21.15.160:6818/25441","state":["exists","up"]},{"osd":1,"uuid":"464764e2-a47e-43c0-8c93-b6bfd10ba526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":25442},{"type":"v1","addr":"172.21.15.160:6825","nonce":25442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":25442},{"type":"v1","addr":"172.21.15.160:6827","nonce":25442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":25442},{"type":"v1","addr":"172.21.15.160:6831","nonce":25442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":25442},{"type":"v1","addr":"172.21.15.160:6829","nonce":25442}]},"public_addr":"172.21.15.160:6825/25442","cluster_addr":"172.21.15.160:6827/25442","heartbeat_back_addr":"172.21.15.160:6831/25442","heartbeat_front_addr":"172.21.15.160:6829/25442","state":["exists","up"]},{"osd":2,"uuid":"4dbfea57-14b6-4c67-8312-fc7d71ef77a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":25443},{"type":"v1","addr":"172.21.15.160:6811","nonce":25443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6813","nonce":25443},{"type":"v1","addr":"172.21.15.160:6815","nonce":25443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":25443},{"type":"v1","addr":"172.21.15.160:6823","nonce":25443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":25443},{"type":"v1","addr":"172.21.15.160:6819","nonce":25443}]},"public_addr":"172.21.15.160:6811/25443","cluster_addr":"172.21.15.160:6815/25443","heartbeat_back_addr":"172.21.15.160:6823/25443","heartbeat_front_addr":"172.21.15.160:6819/25443","state":["exists","up"]},{"osd":3,"uuid":"c53ed58d-a1f3-4783-8677-9348a1d103f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":25440},{"type":"v1","addr":"172.21.15.160:6801","nonce":25440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":25440},{"type":"v1","addr":"172.21.15.160:6803","nonce":25440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":25440},{"type":"v1","addr":"172.21.15.160:6807","nonce":25440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":25440},{"type":"v1","addr":"172.21.15.160:6805","nonce":25440}]},"public_addr":"172.21.15.160:6801/25440","cluster_addr":"172.21.15.160:6803/25440","heartbeat_back_addr":"172.21.15.160:6807/25440","heartbeat_front_addr":"172.21.15.160:6805/25440","state":["exists","up"]},{"osd":4,"uuid":"5713dbd4-1736-4ebf-8102-e80f4db6bcc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":25559},{"type":"v1","addr":"172.21.15.171:6817","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":25559},{"type":"v1","addr":"172.21.15.171:6819","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":25559},{"type":"v1","addr":"172.21.15.171:6826","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":25559},{"type":"v1","addr":"172.21.15.171:6821","nonce":25559}]},"public_addr":"172.21.15.171:6817/25559","cluster_addr":"172.21.15.171:6819/25559","heartbeat_back_addr":"172.21.15.171:6826/25559","heartbeat_front_addr":"172.21.15.171:6821/25559","state":["exists","up"]},{"osd":5,"uuid":"dfe21128-6ae6-4662-9f47-1bbb423a2232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":25549},{"type":"v1","addr":"172.21.15.171:6801","nonce":25549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":25549},{"type":"v1","addr":"172.21.15.171:6803","nonce":25549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":25549},{"type":"v1","addr":"172.21.15.171:6807","nonce":25549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":25549},{"type":"v1","addr":"172.21.15.171:6805","nonce":25549}]},"public_addr":"172.21.15.171:6801/25549","cluster_addr":"172.21.15.171:6803/25549","heartbeat_back_addr":"172.21.15.171:6807/25549","heartbeat_front_addr":"172.21.15.171:6805/25549","state":["exists","up"]},{"osd":6,"uuid":"24a9b956-5fa1-41bf-a689-0f048b7f19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":25574},{"type":"v1","addr":"172.21.15.171:6823","nonce":25574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":25574},{"type":"v1","addr":"172.21.15.171:6827","nonce":25574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":25574},{"type":"v1","addr":"172.21.15.171:6831","nonce":25574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":25574},{"type":"v1","addr":"172.21.15.171:6829","nonce":25574}]},"public_addr":"172.21.15.171:6823/25574","cluster_addr":"172.21.15.171:6827/25574","heartbeat_back_addr":"172.21.15.171:6831/25574","heartbeat_front_addr":"172.21.15.171:6829/25574","state":["exists","up"]},{"osd":7,"uuid":"a5ab4a14-8a7b-43b8-932c-a950f81c10f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":25550},{"type":"v1","addr":"172.21.15.171:6809","nonce":25550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":25550},{"type":"v1","addr":"172.21.15.171:6811","nonce":25550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":25550},{"type":"v1","addr":"172.21.15.171:6815","nonce":25550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":25550},{"type":"v1","addr":"172.21.15.171:6813","nonce":25550}]},"public_addr":"172.21.15.171:6809/25550","cluster_addr":"172.21.15.171:6811/25550","heartbeat_back_addr":"172.21.15.171:6815/25550","heartbeat_front_addr":"172.21.15.171:6813/25550","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.888796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.906098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.896027+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.876694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954695+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.846031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.883631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-21T13:54:24.218 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 -- 172.21.15.160:0/2115426548 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb838063c90 msgr2=0x7fb838066140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.218 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb838063c90 0x7fb838066140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb858154680 tx=0x7fb84c008040 comp rx=0 tx=0).stop 2022-03-21T13:54:24.219 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 -- 172.21.15.160:0/2115426548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb85806c1c0 msgr2=0x7fb85814f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.219 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb85806c1c0 0x7fb85814f050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb850007fd0 tx=0x7fb850007f20 comp rx=0 tx=0).stop 2022-03-21T13:54:24.219 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 -- 172.21.15.160:0/2115426548 shutdown_connections 2022-03-21T13:54:24.219 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb838063c90 0x7fb838066140 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.220 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb85814ce20 0x7fb8581636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.220 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb85806c1c0 0x7fb85814f050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.220 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 --2- 172.21.15.160:0/2115426548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb85814ca50 0x7fb858162cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.220 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 -- 172.21.15.160:0/2115426548 >> 172.21.15.160:0/2115426548 conn(0x7fb8580c9710 msgr2=0x7fb8580c79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:24.220 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 -- 172.21.15.160:0/2115426548 shutdown_connections 2022-03-21T13:54:24.221 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.217+0000 7fb857fff700 1 -- 172.21.15.160:0/2115426548 wait complete. 2022-03-21T13:54:24.229 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-03-21T13:54:21.458770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2022-03-21T13:54:21.499620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2022-03-21T13:54:24.230 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-03-21T13:54:24.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.346+0000 7fddfd0c8700 1 Processor -- start 2022-03-21T13:54:24.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.346+0000 7fddfd0c8700 1 -- start start 2022-03-21T13:54:24.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.346+0000 7fddfd0c8700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddf80bf3d0 0x7fddf80c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.346+0000 7fddfd0c8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fddf806c6c0 0x7fddf806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.346+0000 7fddfd0c8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf80c1830 con 0x7fddf80c2e10 2022-03-21T13:54:24.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.346+0000 7fddfd0c8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf80c1cc0 con 0x7fddf806c6c0 2022-03-21T13:54:24.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.346+0000 7fddfd0c8700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf806c230 con 0x7fddf80bf3d0 2022-03-21T13:54:24.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.346+0000 7fddf759e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fddf806c6c0 0x7fddf806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf659c700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fddf80c2e10 0x7fddf80c4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59322/0 (socket says 172.21.15.160:59322) 2022-03-21T13:54:24.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf759e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fddf806c6c0 0x7fddf806cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56172/0 (socket says 172.21.15.160:56172) 2022-03-21T13:54:24.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf659c700 1 -- 172.21.15.160:0/3937221579 learned_addr learned my addr 172.21.15.160:0/3937221579 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:24.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf6d9d700 1 --2- 172.21.15.160:0/3937221579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddf80bf3d0 0x7fddf80c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf759e700 1 -- 172.21.15.160:0/3937221579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddf80bf3d0 msgr2=0x7fddf80c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:24.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf759e700 1 --2- 172.21.15.160:0/3937221579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddf80bf3d0 0x7fddf80c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf759e700 1 -- 172.21.15.160:0/3937221579 >> v1:172.21.15.160:6789/0 conn(0x7fddf80c2e10 legacy=0x7fddf80c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf5d9b700 1 -- 172.21.15.160:0/3937221579 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562476683 0 0) 0x7fddf80c1830 con 0x7fddf80c2e10 2022-03-21T13:54:24.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf759e700 1 -- 172.21.15.160:0/3937221579 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf806d080 con 0x7fddf806c6c0 2022-03-21T13:54:24.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf759e700 1 --2- 172.21.15.160:0/3937221579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf806c6c0 0x7fddf806cb40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009760 tx=0x7fddf0009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dec19b1b7674cdd server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.354 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf5d9b700 1 -- 172.21.15.160:0/3937221579 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0011630 con 0x7fddf806c6c0 2022-03-21T13:54:24.354 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf5d9b700 1 -- 172.21.15.160:0/3937221579 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0011790 con 0x7fddf806c6c0 2022-03-21T13:54:24.354 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.347+0000 7fddf5d9b700 1 -- 172.21.15.160:0/3937221579 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0011b30 con 0x7fddf806c6c0 2022-03-21T13:54:24.354 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.348+0000 7fddfd0c8700 1 -- 172.21.15.160:0/3937221579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf806c6c0 msgr2=0x7fddf806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.348+0000 7fddfd0c8700 1 --2- 172.21.15.160:0/3937221579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf806c6c0 0x7fddf806cb40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009760 tx=0x7fddf0009060 comp rx=0 tx=0).stop 2022-03-21T13:54:24.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.348+0000 7fddfd0c8700 1 -- 172.21.15.160:0/3937221579 shutdown_connections 2022-03-21T13:54:24.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.348+0000 7fddfd0c8700 1 --2- 172.21.15.160:0/3937221579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf806c6c0 0x7fddf806cb40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.348+0000 7fddfd0c8700 1 --2- 172.21.15.160:0/3937221579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddf80bf3d0 0x7fddf80c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.348+0000 7fddfd0c8700 1 -- 172.21.15.160:0/3937221579 >> 172.21.15.160:0/3937221579 conn(0x7fddf80c9910 msgr2=0x7fddf80c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:24.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.348+0000 7fddfd0c8700 1 -- 172.21.15.160:0/3937221579 shutdown_connections 2022-03-21T13:54:24.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.348+0000 7fddfd0c8700 1 -- 172.21.15.160:0/3937221579 wait complete. 2022-03-21T13:54:24.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.349+0000 7fddfd0c8700 1 Processor -- start 2022-03-21T13:54:24.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.349+0000 7fddfd0c8700 1 -- start start 2022-03-21T13:54:24.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddfd0c8700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddf806c6c0 0x7fddf80bd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddfd0c8700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddf80bf3d0 0x7fddf80bdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddfd0c8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf80c2e10 0x7fddf8150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddfd0c8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf806abc0 con 0x7fddf80c2e10 2022-03-21T13:54:24.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddfd0c8700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8166240 con 0x7fddf80bf3d0 2022-03-21T13:54:24.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddfd0c8700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81664e0 con 0x7fddf806c6c0 2022-03-21T13:54:24.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf759e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf80c2e10 0x7fddf8150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.362 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf759e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf80c2e10 0x7fddf8150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56178/0 (socket says 172.21.15.160:56178) 2022-03-21T13:54:24.362 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf759e700 1 -- 172.21.15.160:0/1412774302 learned_addr learned my addr 172.21.15.160:0/1412774302 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:24.362 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf6d9d700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddf806c6c0 0x7fddf80bd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.362 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf659c700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddf80bf3d0 0x7fddf80bdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.363 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf759e700 1 -- 172.21.15.160:0/1412774302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddf806c6c0 msgr2=0x7fddf80bd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.363 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf759e700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddf806c6c0 0x7fddf80bd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.363 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf759e700 1 -- 172.21.15.160:0/1412774302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddf80bf3d0 msgr2=0x7fddf80bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.363 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf759e700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddf80bf3d0 0x7fddf80bdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.364 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf759e700 1 -- 172.21.15.160:0/1412774302 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf00092a0 con 0x7fddf80c2e10 2022-03-21T13:54:24.364 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf659c700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddf80bf3d0 0x7fddf80bdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:24.364 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddf759e700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf80c2e10 0x7fddf8150d50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009eb0 tx=0x7fddf0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.364 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddeeffd700 1 -- 172.21.15.160:0/1412774302 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0011630 con 0x7fddf80c2e10 2022-03-21T13:54:24.364 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddeeffd700 1 -- 172.21.15.160:0/1412774302 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0003d00 con 0x7fddf80c2e10 2022-03-21T13:54:24.365 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddfd0c8700 1 -- 172.21.15.160:0/1412774302 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf81667c0 con 0x7fddf80c2e10 2022-03-21T13:54:24.365 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddeeffd700 1 -- 172.21.15.160:0/1412774302 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0004570 con 0x7fddf80c2e10 2022-03-21T13:54:24.365 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.350+0000 7fddfd0c8700 1 -- 172.21.15.160:0/1412774302 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf8166d80 con 0x7fddf80c2e10 2022-03-21T13:54:24.366 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.351+0000 7fddfd0c8700 1 -- 172.21.15.160:0/1412774302 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf806fc00 con 0x7fddf80c2e10 2022-03-21T13:54:24.366 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.352+0000 7fddeeffd700 1 -- 172.21.15.160:0/1412774302 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fddf000f050 con 0x7fddf80c2e10 2022-03-21T13:54:24.366 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.352+0000 7fddeeffd700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fdddc063d10 0x7fdddc0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.366 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.352+0000 7fddeeffd700 1 -- 172.21.15.160:0/1412774302 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fddf0081be0 con 0x7fddf80c2e10 2022-03-21T13:54:24.366 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.352+0000 7fddf6d9d700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fdddc063d10 0x7fdddc0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.367 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.352+0000 7fddf6d9d700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fdddc063d10 0x7fdddc0661c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009fd0 tx=0x7fdde8009880 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.367 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.356+0000 7fddeeffd700 1 -- 172.21.15.160:0/1412774302 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fddf0050b10 con 0x7fddf80c2e10 2022-03-21T13:54:24.526 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.525+0000 7fddfd0c8700 1 -- 172.21.15.160:0/1412774302 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fddf806db20 con 0x7fddf80c2e10 2022-03-21T13:54:24.527 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.526+0000 7fddeeffd700 1 -- 172.21.15.160:0/1412774302 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fddf00150a0 con 0x7fddf80c2e10 2022-03-21T13:54:24.527 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2022-03-21T13:54:24.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.527+0000 7fddfd0c8700 1 -- 172.21.15.160:0/1412774302 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fdddc063d10 msgr2=0x7fdddc0661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.527+0000 7fddfd0c8700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fdddc063d10 0x7fdddc0661c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009fd0 tx=0x7fdde8009880 comp rx=0 tx=0).stop 2022-03-21T13:54:24.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.527+0000 7fddfd0c8700 1 -- 172.21.15.160:0/1412774302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf80c2e10 msgr2=0x7fddf8150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.530 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.527+0000 7fddfd0c8700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf80c2e10 0x7fddf8150d50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009eb0 tx=0x7fddf0017000 comp rx=0 tx=0).stop 2022-03-21T13:54:24.530 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.527+0000 7fddfd0c8700 1 -- 172.21.15.160:0/1412774302 shutdown_connections 2022-03-21T13:54:24.530 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.527+0000 7fddfd0c8700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fdddc063d10 0x7fdddc0661c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.530 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.527+0000 7fddfd0c8700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf80c2e10 0x7fddf8150d50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.531 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.527+0000 7fddfd0c8700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddf806c6c0 0x7fddf80bd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.531 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.527+0000 7fddfd0c8700 1 --2- 172.21.15.160:0/1412774302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddf80bf3d0 0x7fddf80bdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.531 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.528+0000 7fddfd0c8700 1 -- 172.21.15.160:0/1412774302 >> 172.21.15.160:0/1412774302 conn(0x7fddf80c9910 msgr2=0x7fddf8153370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:24.531 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.528+0000 7fddfd0c8700 1 -- 172.21.15.160:0/1412774302 shutdown_connections 2022-03-21T13:54:24.531 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.528+0000 7fddfd0c8700 1 -- 172.21.15.160:0/1412774302 wait complete. 2022-03-21T13:54:24.540 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-03-21T13:54:24.657 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.656+0000 7fab3ce59700 1 Processor -- start 2022-03-21T13:54:24.657 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.656+0000 7fab3ce59700 1 -- start start 2022-03-21T13:54:24.662 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab3ce59700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fab380bf3d0 0x7fab380c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.663 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab3ce59700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab380c2e10 0x7fab380c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.663 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab3ce59700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fab380c48c0 0x7fab3806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.663 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab3ce59700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab380c1cc0 con 0x7fab380c48c0 2022-03-21T13:54:24.663 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab3ce59700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab380c1830 con 0x7fab380bf3d0 2022-03-21T13:54:24.663 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab3ce59700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3806c230 con 0x7fab380c2e10 2022-03-21T13:54:24.664 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab36d9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fab380c48c0 0x7fab3806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.664 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab36d9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fab380c48c0 0x7fab3806c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56184/0 (socket says 172.21.15.160:56184) 2022-03-21T13:54:24.664 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab36d9d700 1 -- 172.21.15.160:0/1736538922 learned_addr learned my addr 172.21.15.160:0/1736538922 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:24.664 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab3659c700 1 --2- 172.21.15.160:0/1736538922 >> v2:172.21.15.171:3300/0 conn(0x7fab380bf3d0 0x7fab380c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.665 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab35d9b700 1 --2- 172.21.15.160:0/1736538922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab380c2e10 0x7fab380c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.665 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab36d9d700 1 -- 172.21.15.160:0/1736538922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab380c2e10 msgr2=0x7fab380c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:24.665 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab36d9d700 1 --2- 172.21.15.160:0/1736538922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab380c2e10 0x7fab380c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.665 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab36d9d700 1 -- 172.21.15.160:0/1736538922 >> v2:172.21.15.171:3300/0 conn(0x7fab380bf3d0 msgr2=0x7fab380c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:24.666 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab36d9d700 1 --2- 172.21.15.160:0/1736538922 >> v2:172.21.15.171:3300/0 conn(0x7fab380bf3d0 0x7fab380c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.666 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab36d9d700 1 -- 172.21.15.160:0/1736538922 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab380c56e0 con 0x7fab380c48c0 2022-03-21T13:54:24.666 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.657+0000 7fab36d9d700 1 --2- 172.21.15.160:0/1736538922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab380c48c0 0x7fab3806c6c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab38069850 tx=0x7fab300090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9580b4c693b839c6 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.666 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3559a700 1 -- 172.21.15.160:0/1736538922 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30004030 con 0x7fab380c48c0 2022-03-21T13:54:24.667 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3559a700 1 -- 172.21.15.160:0/1736538922 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab300041d0 con 0x7fab380c48c0 2022-03-21T13:54:24.667 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3559a700 1 -- 172.21.15.160:0/1736538922 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30011630 con 0x7fab380c48c0 2022-03-21T13:54:24.667 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3ce59700 1 -- 172.21.15.160:0/1736538922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab380c48c0 msgr2=0x7fab3806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.667 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3ce59700 1 --2- 172.21.15.160:0/1736538922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab380c48c0 0x7fab3806c6c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab38069850 tx=0x7fab300090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.668 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3ce59700 1 -- 172.21.15.160:0/1736538922 shutdown_connections 2022-03-21T13:54:24.668 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3ce59700 1 --2- 172.21.15.160:0/1736538922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab380c48c0 0x7fab3806c6c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.668 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3ce59700 1 --2- 172.21.15.160:0/1736538922 >> v2:172.21.15.171:3300/0 conn(0x7fab380bf3d0 0x7fab380c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.668 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3ce59700 1 --2- 172.21.15.160:0/1736538922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab380c2e10 0x7fab380c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.668 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3ce59700 1 -- 172.21.15.160:0/1736538922 >> 172.21.15.160:0/1736538922 conn(0x7fab380c9910 msgr2=0x7fab380c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:24.669 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3ce59700 1 -- 172.21.15.160:0/1736538922 shutdown_connections 2022-03-21T13:54:24.669 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.658+0000 7fab3ce59700 1 -- 172.21.15.160:0/1736538922 wait complete. 2022-03-21T13:54:24.669 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.659+0000 7fab3ce59700 1 Processor -- start 2022-03-21T13:54:24.670 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.659+0000 7fab3ce59700 1 -- start start 2022-03-21T13:54:24.670 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3ce59700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab380bf3d0 0x7fab38067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.670 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3ce59700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab380c2e10 0x7fab38068230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.670 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3ce59700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab380c48c0 0x7fab3814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.670 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3ce59700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab381655e0 con 0x7fab380bf3d0 2022-03-21T13:54:24.671 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3ce59700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab38165880 con 0x7fab380c2e10 2022-03-21T13:54:24.671 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3ce59700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3806c690 con 0x7fab380c48c0 2022-03-21T13:54:24.671 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab380bf3d0 0x7fab38067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.671 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab380bf3d0 0x7fab38067cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56190/0 (socket says 172.21.15.160:56190) 2022-03-21T13:54:24.672 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3659c700 1 -- 172.21.15.160:0/2375057758 learned_addr learned my addr 172.21.15.160:0/2375057758 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:24.672 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab36d9d700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab380c48c0 0x7fab3814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.672 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab35d9b700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab380c2e10 0x7fab38068230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.672 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3659c700 1 -- 172.21.15.160:0/2375057758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab380c48c0 msgr2=0x7fab3814eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.672 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3659c700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab380c48c0 0x7fab3814eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.673 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3659c700 1 -- 172.21.15.160:0/2375057758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab380c2e10 msgr2=0x7fab38068230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.673 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3659c700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab380c2e10 0x7fab38068230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.673 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3659c700 1 -- 172.21.15.160:0/2375057758 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab30009370 con 0x7fab380bf3d0 2022-03-21T13:54:24.673 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab36d9d700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab380c48c0 0x7fab3814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:24.674 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.660+0000 7fab3659c700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab380bf3d0 0x7fab38067cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab2800e190 tx=0x7fab28009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.674 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.661+0000 7fab2e7fc700 1 -- 172.21.15.160:0/2375057758 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2800ed80 con 0x7fab380bf3d0 2022-03-21T13:54:24.674 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.661+0000 7fab2e7fc700 1 -- 172.21.15.160:0/2375057758 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab28014420 con 0x7fab380bf3d0 2022-03-21T13:54:24.674 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.661+0000 7fab3ce59700 1 -- 172.21.15.160:0/2375057758 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3806c970 con 0x7fab380bf3d0 2022-03-21T13:54:24.674 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.661+0000 7fab2e7fc700 1 -- 172.21.15.160:0/2375057758 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280147e0 con 0x7fab380bf3d0 2022-03-21T13:54:24.675 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.661+0000 7fab3ce59700 1 -- 172.21.15.160:0/2375057758 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3806cf30 con 0x7fab380bf3d0 2022-03-21T13:54:24.675 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.661+0000 7fab3ce59700 1 -- 172.21.15.160:0/2375057758 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab38064140 con 0x7fab380bf3d0 2022-03-21T13:54:24.675 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.662+0000 7fab2e7fc700 1 -- 172.21.15.160:0/2375057758 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fab28012050 con 0x7fab380bf3d0 2022-03-21T13:54:24.676 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.662+0000 7fab2e7fc700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fab1c063ce0 0x7fab1c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.676 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.662+0000 7fab35d9b700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fab1c063ce0 0x7fab1c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.677 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.662+0000 7fab2e7fc700 1 -- 172.21.15.160:0/2375057758 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fab28080ba0 con 0x7fab380bf3d0 2022-03-21T13:54:24.678 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.663+0000 7fab35d9b700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fab1c063ce0 0x7fab1c066190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab380c20f0 tx=0x7fab20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.678 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.666+0000 7fab2e7fc700 1 -- 172.21.15.160:0/2375057758 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fab2804fad0 con 0x7fab380bf3d0 2022-03-21T13:54:24.836 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.835+0000 7fab3ce59700 1 -- 172.21.15.160:0/2375057758 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab3806fc00 con 0x7fab380bf3d0 2022-03-21T13:54:24.837 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.836+0000 7fab2e7fc700 1 -- 172.21.15.160:0/2375057758 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab28009a60 con 0x7fab380bf3d0 2022-03-21T13:54:24.837 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 1 2022-03-21T13:54:24.839 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 -- 172.21.15.160:0/2375057758 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fab1c063ce0 msgr2=0x7fab1c066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.839 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fab1c063ce0 0x7fab1c066190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab380c20f0 tx=0x7fab20008040 comp rx=0 tx=0).stop 2022-03-21T13:54:24.839 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 -- 172.21.15.160:0/2375057758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab380bf3d0 msgr2=0x7fab38067cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.840 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab380bf3d0 0x7fab38067cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab2800e190 tx=0x7fab28009920 comp rx=0 tx=0).stop 2022-03-21T13:54:24.840 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 -- 172.21.15.160:0/2375057758 shutdown_connections 2022-03-21T13:54:24.840 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fab1c063ce0 0x7fab1c066190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.840 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab380c48c0 0x7fab3814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.841 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab380bf3d0 0x7fab38067cf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.841 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 --2- 172.21.15.160:0/2375057758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab380c2e10 0x7fab38068230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.841 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 -- 172.21.15.160:0/2375057758 >> 172.21.15.160:0/2375057758 conn(0x7fab380c9910 msgr2=0x7fab38153370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:24.841 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 -- 172.21.15.160:0/2375057758 shutdown_connections 2022-03-21T13:54:24.841 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.838+0000 7fab3ce59700 1 -- 172.21.15.160:0/2375057758 wait complete. 2022-03-21T13:54:24.850 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-03-21T13:54:24.963 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.962+0000 7f4d78089700 1 Processor -- start 2022-03-21T13:54:24.964 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.963+0000 7f4d78089700 1 -- start start 2022-03-21T13:54:24.966 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.963+0000 7f4d78089700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4d7014ec50 0x7f4d700c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.967 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.963+0000 7f4d78089700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d70067ab0 con 0x7f4d700c53e0 2022-03-21T13:54:24.967 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.963+0000 7f4d78089700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700c3a20 con 0x7f4d7014f020 2022-03-21T13:54:24.967 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.963+0000 7f4d78089700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700c32c0 con 0x7f4d7014ec50 2022-03-21T13:54:24.967 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.964+0000 7f4d75e25700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4d7014ec50 0x7f4d700c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.964+0000 7f4d75624700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f4d700c53e0 0x7f4d7006c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59348/0 (socket says 172.21.15.160:59348) 2022-03-21T13:54:24.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.964+0000 7f4d75624700 1 -- 172.21.15.160:0/3151401774 learned_addr learned my addr 172.21.15.160:0/3151401774 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:24.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.964+0000 7f4d75e25700 1 -- 172.21.15.160:0/3151401774 >> v1:172.21.15.171:6789/0 conn(0x7f4d7014f020 legacy=0x7f4d70154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.964+0000 7f4d75e25700 1 -- 172.21.15.160:0/3151401774 >> v1:172.21.15.160:6789/0 conn(0x7f4d700c53e0 legacy=0x7f4d7006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.964+0000 7f4d75e25700 1 -- 172.21.15.160:0/3151401774 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7014f480 con 0x7f4d7014ec50 2022-03-21T13:54:24.969 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.964+0000 7f4d74e23700 1 -- 172.21.15.160:0/3151401774 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062560532 0 0) 0x7f4d70067ab0 con 0x7f4d700c53e0 2022-03-21T13:54:24.969 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.964+0000 7f4d75e25700 1 --2- 172.21.15.160:0/3151401774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d7014ec50 0x7f4d700c6280 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009e60 tx=0x7f4d68009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa31c626aae6203 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.969 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.964+0000 7f4d74e23700 1 -- 172.21.15.160:0/3151401774 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800e070 con 0x7f4d7014ec50 2022-03-21T13:54:24.969 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.964+0000 7f4d74e23700 1 -- 172.21.15.160:0/3151401774 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6800bc30 con 0x7f4d7014ec50 2022-03-21T13:54:24.970 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.964+0000 7f4d74e23700 1 -- 172.21.15.160:0/3151401774 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68012430 con 0x7f4d7014ec50 2022-03-21T13:54:24.970 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.965+0000 7f4d78089700 1 -- 172.21.15.160:0/3151401774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d7014ec50 msgr2=0x7f4d700c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.970 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.965+0000 7f4d78089700 1 --2- 172.21.15.160:0/3151401774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d7014ec50 0x7f4d700c6280 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009e60 tx=0x7f4d68009780 comp rx=0 tx=0).stop 2022-03-21T13:54:24.970 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.965+0000 7f4d78089700 1 -- 172.21.15.160:0/3151401774 shutdown_connections 2022-03-21T13:54:24.971 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.965+0000 7f4d78089700 1 --2- 172.21.15.160:0/3151401774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d7014ec50 0x7f4d700c6280 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.971 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.965+0000 7f4d78089700 1 -- 172.21.15.160:0/3151401774 >> 172.21.15.160:0/3151401774 conn(0x7f4d700c98f0 msgr2=0x7f4d700c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:24.971 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.965+0000 7f4d78089700 1 -- 172.21.15.160:0/3151401774 shutdown_connections 2022-03-21T13:54:24.971 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.965+0000 7f4d78089700 1 -- 172.21.15.160:0/3151401774 wait complete. 2022-03-21T13:54:24.972 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.966+0000 7f4d78089700 1 Processor -- start 2022-03-21T13:54:24.972 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.966+0000 7f4d78089700 1 -- start start 2022-03-21T13:54:24.975 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.966+0000 7f4d78089700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d700c53e0 0x7f4d700aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.975 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d78089700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d7014ec50 0x7f4d700aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.976 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d78089700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d7014f020 0x7f4d70149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.976 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d78089700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700aa470 con 0x7f4d700c53e0 2022-03-21T13:54:24.976 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d78089700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7006d0c0 con 0x7f4d7014f020 2022-03-21T13:54:24.976 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d78089700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7006d3a0 con 0x7f4d7014ec50 2022-03-21T13:54:24.977 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d75e25700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d700c53e0 0x7f4d700aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.977 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d75e25700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d700c53e0 0x7f4d700aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56200/0 (socket says 172.21.15.160:56200) 2022-03-21T13:54:24.977 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d75e25700 1 -- 172.21.15.160:0/1164909640 learned_addr learned my addr 172.21.15.160:0/1164909640 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:24.977 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d76626700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d7014f020 0x7f4d70149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.977 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d75624700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d7014ec50 0x7f4d700aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.978 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d75e25700 1 -- 172.21.15.160:0/1164909640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d7014ec50 msgr2=0x7f4d700aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.978 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d75e25700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d7014ec50 0x7f4d700aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.978 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d75e25700 1 -- 172.21.15.160:0/1164909640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d7014f020 msgr2=0x7f4d70149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:24.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d75e25700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d7014f020 0x7f4d70149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:24.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d75e25700 1 -- 172.21.15.160:0/1164909640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d68009a20 con 0x7f4d700c53e0 2022-03-21T13:54:24.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d75624700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d7014ec50 0x7f4d700aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:24.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d75e25700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d700c53e0 0x7f4d700aa970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4d68012580 tx=0x7f4d68019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d61ffb700 1 -- 172.21.15.160:0/1164909640 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68012e60 con 0x7f4d700c53e0 2022-03-21T13:54:24.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d61ffb700 1 -- 172.21.15.160:0/1164909640 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6801b420 con 0x7f4d700c53e0 2022-03-21T13:54:24.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d78089700 1 -- 172.21.15.160:0/1164909640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7006d680 con 0x7f4d700c53e0 2022-03-21T13:54:24.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d61ffb700 1 -- 172.21.15.160:0/1164909640 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6801b7c0 con 0x7f4d700c53e0 2022-03-21T13:54:24.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.967+0000 7f4d78089700 1 -- 172.21.15.160:0/1164909640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d700bf8e0 con 0x7f4d700c53e0 2022-03-21T13:54:24.981 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.968+0000 7f4d78089700 1 -- 172.21.15.160:0/1164909640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d700aa7c0 con 0x7f4d700c53e0 2022-03-21T13:54:24.981 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.969+0000 7f4d61ffb700 1 -- 172.21.15.160:0/1164909640 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f4d6802c030 con 0x7f4d700c53e0 2022-03-21T13:54:24.981 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.969+0000 7f4d61ffb700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4d50063ce0 0x7f4d50066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:24.981 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.969+0000 7f4d61ffb700 1 -- 172.21.15.160:0/1164909640 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4d68082160 con 0x7f4d700c53e0 2022-03-21T13:54:24.981 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.969+0000 7f4d75624700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4d50063ce0 0x7f4d50066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:24.982 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.969+0000 7f4d75624700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4d50063ce0 0x7f4d50066190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d70167640 tx=0x7f4d64007b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:24.982 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:24.973+0000 7f4d61ffb700 1 -- 172.21.15.160:0/1164909640 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f4d68051030 con 0x7f4d700c53e0 2022-03-21T13:54:25.147 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.146+0000 7f4d78089700 1 -- 172.21.15.160:0/1164909640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4d7006fc00 con 0x7f4d700c53e0 2022-03-21T13:54:25.147 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.146+0000 7f4d61ffb700 1 -- 172.21.15.160:0/1164909640 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4d68054650 con 0x7f4d700c53e0 2022-03-21T13:54:25.148 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:25.148 INFO:teuthology.orchestra.run.smithi160.stdout:[ 2022-03-21T13:54:25.148 INFO:teuthology.orchestra.run.smithi160.stdout: { 2022-03-21T13:54:25.148 INFO:teuthology.orchestra.run.smithi160.stdout: "poolnum": 1, 2022-03-21T13:54:25.149 INFO:teuthology.orchestra.run.smithi160.stdout: "poolname": "rbd" 2022-03-21T13:54:25.149 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2022-03-21T13:54:25.149 INFO:teuthology.orchestra.run.smithi160.stdout: { 2022-03-21T13:54:25.149 INFO:teuthology.orchestra.run.smithi160.stdout: "poolnum": 2, 2022-03-21T13:54:25.149 INFO:teuthology.orchestra.run.smithi160.stdout: "poolname": ".mgr" 2022-03-21T13:54:25.150 INFO:teuthology.orchestra.run.smithi160.stdout: } 2022-03-21T13:54:25.150 INFO:teuthology.orchestra.run.smithi160.stdout:] 2022-03-21T13:54:25.151 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.148+0000 7f4d78089700 1 -- 172.21.15.160:0/1164909640 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4d50063ce0 msgr2=0x7f4d50066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:25.151 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.148+0000 7f4d78089700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4d50063ce0 0x7f4d50066190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d70167640 tx=0x7f4d64007b90 comp rx=0 tx=0).stop 2022-03-21T13:54:25.151 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.148+0000 7f4d78089700 1 -- 172.21.15.160:0/1164909640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d700c53e0 msgr2=0x7f4d700aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:25.152 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.148+0000 7f4d78089700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d700c53e0 0x7f4d700aa970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4d68012580 tx=0x7f4d68019000 comp rx=0 tx=0).stop 2022-03-21T13:54:25.152 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.148+0000 7f4d78089700 1 -- 172.21.15.160:0/1164909640 shutdown_connections 2022-03-21T13:54:25.152 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.148+0000 7f4d78089700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4d50063ce0 0x7f4d50066190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:25.152 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.148+0000 7f4d78089700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d7014f020 0x7f4d70149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:25.152 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.148+0000 7f4d78089700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d700c53e0 0x7f4d700aa970 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:25.153 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.148+0000 7f4d78089700 1 --2- 172.21.15.160:0/1164909640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d7014ec50 0x7f4d700aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:25.153 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.148+0000 7f4d78089700 1 -- 172.21.15.160:0/1164909640 >> 172.21.15.160:0/1164909640 conn(0x7f4d700c98f0 msgr2=0x7f4d700c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:25.153 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.149+0000 7f4d78089700 1 -- 172.21.15.160:0/1164909640 shutdown_connections 2022-03-21T13:54:25.153 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.149+0000 7f4d78089700 1 -- 172.21.15.160:0/1164909640 wait complete. 2022-03-21T13:54:25.161 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-03-21T13:54:25.162 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2022-03-21T13:54:25.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.278+0000 7f7767b91700 1 Processor -- start 2022-03-21T13:54:25.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.278+0000 7f7767b91700 1 -- start start 2022-03-21T13:54:25.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.279+0000 7f7767b91700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7760155890 0x7f7760069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:25.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.279+0000 7f7767b91700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 0x7f77600c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:25.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.279+0000 7f7767b91700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776006c070 con 0x7f776006b8f0 2022-03-21T13:54:25.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.279+0000 7f7767b91700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77600c7670 con 0x7f7760155890 2022-03-21T13:54:25.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.279+0000 7f7767b91700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776006ced0 con 0x7f77600c3020 2022-03-21T13:54:25.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.279+0000 7f776592d700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7760155890 0x7f7760069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:25.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.279+0000 7f776612e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 0x7f77600c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:25.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.279+0000 7f776512c700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f776006b8f0 0x7f776006a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:52448/0 (socket says 172.21.15.160:52448) 2022-03-21T13:54:25.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.279+0000 7f776512c700 1 -- 172.21.15.160:0/776024712 learned_addr learned my addr 172.21.15.160:0/776024712 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:25.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f776592d700 1 -- 172.21.15.160:0/776024712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 msgr2=0x7f77600c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:25.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f776592d700 1 --2- 172.21.15.160:0/776024712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 0x7f77600c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:25.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f776592d700 1 -- 172.21.15.160:0/776024712 >> v1:172.21.15.171:6789/0 conn(0x7f776006b8f0 legacy=0x7f776006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:25.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f776592d700 1 -- 172.21.15.160:0/776024712 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77600c39e0 con 0x7f7760155890 2022-03-21T13:54:25.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f776612e700 1 --2- 172.21.15.160:0/776024712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 0x7f77600c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:25.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f776592d700 1 --2- 172.21.15.160:0/776024712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760155890 0x7f7760069fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7750009e60 tx=0x7f7750009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d60f2c97a439a1f server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:25.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f776492b700 1 -- 172.21.15.160:0/776024712 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775000e070 con 0x7f7760155890 2022-03-21T13:54:25.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f776492b700 1 -- 172.21.15.160:0/776024712 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775000bbf0 con 0x7f7760155890 2022-03-21T13:54:25.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f776492b700 1 -- 172.21.15.160:0/776024712 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750012430 con 0x7f7760155890 2022-03-21T13:54:25.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f7767b91700 1 -- 172.21.15.160:0/776024712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760155890 msgr2=0x7f7760069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:25.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f7767b91700 1 --2- 172.21.15.160:0/776024712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760155890 0x7f7760069fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7750009e60 tx=0x7f7750009780 comp rx=0 tx=0).stop 2022-03-21T13:54:25.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f7767b91700 1 -- 172.21.15.160:0/776024712 shutdown_connections 2022-03-21T13:54:25.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f7767b91700 1 --2- 172.21.15.160:0/776024712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760155890 0x7f7760069fa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:25.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f7767b91700 1 --2- 172.21.15.160:0/776024712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 0x7f77600c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:25.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.280+0000 7f7767b91700 1 -- 172.21.15.160:0/776024712 >> 172.21.15.160:0/776024712 conn(0x7f77600669f0 msgr2=0x7f77600cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:25.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.281+0000 7f7767b91700 1 -- 172.21.15.160:0/776024712 shutdown_connections 2022-03-21T13:54:25.288 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.281+0000 7f7767b91700 1 -- 172.21.15.160:0/776024712 wait complete. 2022-03-21T13:54:25.291 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.282+0000 7f7767b91700 1 Processor -- start 2022-03-21T13:54:25.291 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.282+0000 7f7767b91700 1 -- start start 2022-03-21T13:54:25.291 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.282+0000 7f7767b91700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776006b8f0 0x7f7760150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:25.291 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.282+0000 7f7767b91700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 0x7f7760167590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:25.292 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.282+0000 7f7767b91700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760155890 0x7f7760167ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:25.292 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.282+0000 7f7767b91700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7760154240 con 0x7f776006b8f0 2022-03-21T13:54:25.292 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.282+0000 7f7767b91700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7760167100 con 0x7f7760155890 2022-03-21T13:54:25.292 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.282+0000 7f7767b91700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7760166af0 con 0x7f77600c3020 2022-03-21T13:54:25.293 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.282+0000 7f776592d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776006b8f0 0x7f7760150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:25.293 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.282+0000 7f776592d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776006b8f0 0x7f7760150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56214/0 (socket says 172.21.15.160:56214) 2022-03-21T13:54:25.293 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.282+0000 7f776592d700 1 -- 172.21.15.160:0/2213749032 learned_addr learned my addr 172.21.15.160:0/2213749032 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:25.293 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f776612e700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760155890 0x7f7760167ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:25.294 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f776512c700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 0x7f7760167590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:25.294 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f776592d700 1 -- 172.21.15.160:0/2213749032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 msgr2=0x7f7760167590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:25.294 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f776592d700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 0x7f7760167590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:25.294 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f776592d700 1 -- 172.21.15.160:0/2213749032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760155890 msgr2=0x7f7760167ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:25.295 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f776592d700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760155890 0x7f7760167ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:25.295 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f776592d700 1 -- 172.21.15.160:0/2213749032 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77580092a0 con 0x7f776006b8f0 2022-03-21T13:54:25.295 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f776512c700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 0x7f7760167590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:25.295 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f776592d700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776006b8f0 0x7f7760150760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f775000b6c0 tx=0x7f7750019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:25.295 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f775dffb700 1 -- 172.21.15.160:0/2213749032 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750001070 con 0x7f776006b8f0 2022-03-21T13:54:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f775dffb700 1 -- 172.21.15.160:0/2213749032 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77500129b0 con 0x7f776006b8f0 2022-03-21T13:54:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f7767b91700 1 -- 172.21.15.160:0/2213749032 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7750009a20 con 0x7f776006b8f0 2022-03-21T13:54:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f775dffb700 1 -- 172.21.15.160:0/2213749032 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750012d90 con 0x7f776006b8f0 2022-03-21T13:54:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.283+0000 7f7767b91700 1 -- 172.21.15.160:0/2213749032 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7760169620 con 0x7f776006b8f0 2022-03-21T13:54:25.297 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.284+0000 7f7767b91700 1 -- 172.21.15.160:0/2213749032 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f776006fc00 con 0x7f776006b8f0 2022-03-21T13:54:25.297 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.285+0000 7f775dffb700 1 -- 172.21.15.160:0/2213749032 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f7750004250 con 0x7f776006b8f0 2022-03-21T13:54:25.297 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.285+0000 7f775dffb700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7740063ce0 0x7f7740066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:25.297 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.285+0000 7f775dffb700 1 -- 172.21.15.160:0/2213749032 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f77500829c0 con 0x7f776006b8f0 2022-03-21T13:54:25.297 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.285+0000 7f776512c700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7740063ce0 0x7f7740066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:25.298 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.285+0000 7f776512c700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7740063ce0 0x7f7740066190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f77600c36a0 tx=0x7f7754009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:25.298 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.289+0000 7f775dffb700 1 -- 172.21.15.160:0/2213749032 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f77500519b0 con 0x7f776006b8f0 2022-03-21T13:54:25.465 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:25.464+0000 7f7767b91700 1 -- 172.21.15.160:0/2213749032 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f776006b560 con 0x7f776006b8f0 2022-03-21T13:54:26.160 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.159+0000 7f775dffb700 1 -- 172.21.15.160:0/2213749032 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7750054fd0 con 0x7f776006b8f0 2022-03-21T13:54:26.164 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.163+0000 7f7767b91700 1 -- 172.21.15.160:0/2213749032 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7740063ce0 msgr2=0x7f7740066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:26.164 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.163+0000 7f7767b91700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7740063ce0 0x7f7740066190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f77600c36a0 tx=0x7f7754009040 comp rx=0 tx=0).stop 2022-03-21T13:54:26.164 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.163+0000 7f7767b91700 1 -- 172.21.15.160:0/2213749032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776006b8f0 msgr2=0x7f7760150760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:26.165 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.163+0000 7f7767b91700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776006b8f0 0x7f7760150760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f775000b6c0 tx=0x7f7750019000 comp rx=0 tx=0).stop 2022-03-21T13:54:26.165 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.163+0000 7f7767b91700 1 -- 172.21.15.160:0/2213749032 shutdown_connections 2022-03-21T13:54:26.165 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.163+0000 7f7767b91700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7740063ce0 0x7f7740066190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:26.165 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.163+0000 7f7767b91700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760155890 0x7f7760167ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.163+0000 7f7767b91700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776006b8f0 0x7f7760150760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.163+0000 7f7767b91700 1 --2- 172.21.15.160:0/2213749032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77600c3020 0x7f7760167590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.163+0000 7f7767b91700 1 -- 172.21.15.160:0/2213749032 >> 172.21.15.160:0/2213749032 conn(0x7f77600669f0 msgr2=0x7f77600c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:26.167 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.164+0000 7f7767b91700 1 -- 172.21.15.160:0/2213749032 shutdown_connections 2022-03-21T13:54:26.167 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.164+0000 7f7767b91700 1 -- 172.21.15.160:0/2213749032 wait complete. 2022-03-21T13:54:26.167 INFO:teuthology.orchestra.run.smithi160.stderr:pool 'cephfs_metadata' created 2022-03-21T13:54:26.179 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2022-03-21T13:54:26.301 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.300+0000 7f0606b0a700 1 Processor -- start 2022-03-21T13:54:26.301 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.300+0000 7f0606b0a700 1 -- start start 2022-03-21T13:54:26.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f0606b0a700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f060006d760 0x7f060006c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:26.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f0606b0a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06000c6210 0x7f060006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:26.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f0606b0a700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060006b5a0 con 0x7f0600154b10 2022-03-21T13:54:26.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f0606b0a700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060006db30 con 0x7f060006d760 2022-03-21T13:54:26.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f0606b0a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060006a9e0 con 0x7f06000c6210 2022-03-21T13:54:26.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f05fffff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06000c6210 0x7f060006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:26.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f06050a7700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f0600154b10 0x7f0600154f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:52466/0 (socket says 172.21.15.160:52466) 2022-03-21T13:54:26.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f06050a7700 1 -- 172.21.15.160:0/2489041063 learned_addr learned my addr 172.21.15.160:0/2489041063 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:26.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f06048a6700 1 --2- 172.21.15.160:0/2489041063 >> v2:172.21.15.171:3300/0 conn(0x7f060006d760 0x7f060006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:26.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f05ff7fe700 1 -- 172.21.15.160:0/2489041063 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986985256 0 0) 0x7f060006b5a0 con 0x7f0600154b10 2022-03-21T13:54:26.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f05ff7fe700 1 -- 172.21.15.160:0/2489041063 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e40033f0 con 0x7f0600154b10 2022-03-21T13:54:26.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f06048a6700 1 -- 172.21.15.160:0/2489041063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06000c6210 msgr2=0x7f060006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:26.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f06048a6700 1 --2- 172.21.15.160:0/2489041063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06000c6210 0x7f060006c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:26.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f06048a6700 1 -- 172.21.15.160:0/2489041063 >> v1:172.21.15.171:6789/0 conn(0x7f0600154b10 legacy=0x7f0600154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:26.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f06048a6700 1 -- 172.21.15.160:0/2489041063 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06000c5f30 con 0x7f060006d760 2022-03-21T13:54:26.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.301+0000 7f05fffff700 1 --2- 172.21.15.160:0/2489041063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06000c6210 0x7f060006c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:26.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f06048a6700 1 --2- 172.21.15.160:0/2489041063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060006d760 0x7f060006c070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009760 tx=0x7f05f4009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feaf56cfd81f5f81 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:26.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f05ff7fe700 1 -- 172.21.15.160:0/2489041063 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4011630 con 0x7f060006d760 2022-03-21T13:54:26.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f05ff7fe700 1 -- 172.21.15.160:0/2489041063 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f4011790 con 0x7f060006d760 2022-03-21T13:54:26.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f05ff7fe700 1 -- 172.21.15.160:0/2489041063 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4011b10 con 0x7f060006d760 2022-03-21T13:54:26.313 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f0606b0a700 1 -- 172.21.15.160:0/2489041063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060006d760 msgr2=0x7f060006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:26.313 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f0606b0a700 1 --2- 172.21.15.160:0/2489041063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060006d760 0x7f060006c070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009760 tx=0x7f05f4009060 comp rx=0 tx=0).stop 2022-03-21T13:54:26.313 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f0606b0a700 1 -- 172.21.15.160:0/2489041063 shutdown_connections 2022-03-21T13:54:26.314 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f0606b0a700 1 --2- 172.21.15.160:0/2489041063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060006d760 0x7f060006c070 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:26.314 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f0606b0a700 1 --2- 172.21.15.160:0/2489041063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06000c6210 0x7f060006c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:26.314 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f0606b0a700 1 -- 172.21.15.160:0/2489041063 >> 172.21.15.160:0/2489041063 conn(0x7f0600068640 msgr2=0x7f06000cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:26.314 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f0606b0a700 1 -- 172.21.15.160:0/2489041063 shutdown_connections 2022-03-21T13:54:26.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.302+0000 7f0606b0a700 1 -- 172.21.15.160:0/2489041063 wait complete. 2022-03-21T13:54:26.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.303+0000 7f0606b0a700 1 Processor -- start 2022-03-21T13:54:26.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.304+0000 7f0606b0a700 1 -- start start 2022-03-21T13:54:26.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.304+0000 7f0606b0a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060006d760 0x7f06000b9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:26.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.304+0000 7f0606b0a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06000c6210 0x7f0600159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:26.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.304+0000 7f0606b0a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0600154b10 0x7f06001518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:26.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.304+0000 7f0606b0a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06000b9940 con 0x7f06000c6210 2022-03-21T13:54:26.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.304+0000 7f0606b0a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0600159090 con 0x7f060006d760 2022-03-21T13:54:26.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.304+0000 7f0606b0a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0600159930 con 0x7f0600154b10 2022-03-21T13:54:26.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.304+0000 7f05fffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06000c6210 0x7f0600159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:26.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.304+0000 7f05fffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06000c6210 0x7f0600159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56228/0 (socket says 172.21.15.160:56228) 2022-03-21T13:54:26.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.304+0000 7f05fffff700 1 -- 172.21.15.160:0/1688584630 learned_addr learned my addr 172.21.15.160:0/1688584630 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:26.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f06050a7700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0600154b10 0x7f06001518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:26.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f06048a6700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060006d760 0x7f06000b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:26.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f05fffff700 1 -- 172.21.15.160:0/1688584630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0600154b10 msgr2=0x7f06001518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:26.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f05fffff700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0600154b10 0x7f06001518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:26.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f05fffff700 1 -- 172.21.15.160:0/1688584630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060006d760 msgr2=0x7f06000b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:26.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f05fffff700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060006d760 0x7f06000b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:26.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f05fffff700 1 -- 172.21.15.160:0/1688584630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec0092a0 con 0x7f06000c6210 2022-03-21T13:54:26.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f06048a6700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060006d760 0x7f06000b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:26.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f05fffff700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06000c6210 0x7f0600159dc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00ea20 tx=0x7f05ec009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:26.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f05fcff9700 1 -- 172.21.15.160:0/1688584630 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00c850 con 0x7f06000c6210 2022-03-21T13:54:26.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f05fcff9700 1 -- 172.21.15.160:0/1688584630 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec00c9b0 con 0x7f06000c6210 2022-03-21T13:54:26.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f0606b0a700 1 -- 172.21.15.160:0/1688584630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f40092a0 con 0x7f06000c6210 2022-03-21T13:54:26.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f05fcff9700 1 -- 172.21.15.160:0/1688584630 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00cd50 con 0x7f06000c6210 2022-03-21T13:54:26.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.305+0000 7f0606b0a700 1 -- 172.21.15.160:0/1688584630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060015a300 con 0x7f06000c6210 2022-03-21T13:54:26.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.306+0000 7f0606b0a700 1 -- 172.21.15.160:0/1688584630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060006b930 con 0x7f06000c6210 2022-03-21T13:54:26.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.306+0000 7f05fcff9700 1 -- 172.21.15.160:0/1688584630 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f05ec019030 con 0x7f06000c6210 2022-03-21T13:54:26.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.307+0000 7f05fcff9700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f05e8063ce0 0x7f05e8066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:26.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.307+0000 7f05fcff9700 1 -- 172.21.15.160:0/1688584630 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f05ec0807e0 con 0x7f06000c6210 2022-03-21T13:54:26.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.307+0000 7f06048a6700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f05e8063ce0 0x7f05e8066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:26.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.307+0000 7f06048a6700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f05e8063ce0 0x7f05e8066190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009270 tx=0x7f05f4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:26.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.311+0000 7f05fcff9700 1 -- 172.21.15.160:0/1688584630 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f05ec04f540 con 0x7f06000c6210 2022-03-21T13:54:26.484 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:26.483+0000 7f0606b0a700 1 -- 172.21.15.160:0/1688584630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0600159a70 con 0x7f06000c6210 2022-03-21T13:54:27.165 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.163+0000 7f05fcff9700 1 -- 172.21.15.160:0/1688584630 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f05ec0170d0 con 0x7f06000c6210 2022-03-21T13:54:27.169 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.167+0000 7f0606b0a700 1 -- 172.21.15.160:0/1688584630 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f05e8063ce0 msgr2=0x7f05e8066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.169 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.167+0000 7f0606b0a700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f05e8063ce0 0x7f05e8066190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009270 tx=0x7f05f4017000 comp rx=0 tx=0).stop 2022-03-21T13:54:27.169 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.167+0000 7f0606b0a700 1 -- 172.21.15.160:0/1688584630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06000c6210 msgr2=0x7f0600159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.170 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.167+0000 7f0606b0a700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06000c6210 0x7f0600159dc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00ea20 tx=0x7f05ec009060 comp rx=0 tx=0).stop 2022-03-21T13:54:27.170 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.168+0000 7f0606b0a700 1 -- 172.21.15.160:0/1688584630 shutdown_connections 2022-03-21T13:54:27.171 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.168+0000 7f0606b0a700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f05e8063ce0 0x7f05e8066190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.171 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.168+0000 7f0606b0a700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0600154b10 0x7f06001518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.171 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.168+0000 7f0606b0a700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060006d760 0x7f06000b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.171 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.168+0000 7f0606b0a700 1 --2- 172.21.15.160:0/1688584630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06000c6210 0x7f0600159dc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.172 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.168+0000 7f0606b0a700 1 -- 172.21.15.160:0/1688584630 >> 172.21.15.160:0/1688584630 conn(0x7f0600068640 msgr2=0x7f06001537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:27.172 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.169+0000 7f0606b0a700 1 -- 172.21.15.160:0/1688584630 shutdown_connections 2022-03-21T13:54:27.172 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.169+0000 7f0606b0a700 1 -- 172.21.15.160:0/1688584630 wait complete. 2022-03-21T13:54:27.174 INFO:teuthology.orchestra.run.smithi160.stderr:pool 'cephfs_data' created 2022-03-21T13:54:27.192 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-03-21T13:54:27.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.308+0000 7f820137f700 1 Processor -- start 2022-03-21T13:54:27.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.308+0000 7f820137f700 1 -- start start 2022-03-21T13:54:27.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.309+0000 7f820137f700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc158350 0x7f81fc158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.309+0000 7f820137f700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f81fc0c7400 0x7f81fc158c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.309+0000 7f820137f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81fc0c4ec0 con 0x7f81fc06a720 2022-03-21T13:54:27.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.309+0000 7f820137f700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc0c5a10 con 0x7f81fc0c7400 2022-03-21T13:54:27.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.309+0000 7f820137f700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0c53d0 con 0x7f81fc158350 2022-03-21T13:54:27.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.309+0000 7f81fb7fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f81fc06a720 0x7f81fc0c4110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59392/0 (socket says 172.21.15.160:59392) 2022-03-21T13:54:27.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.309+0000 7f81fb7fe700 1 -- 172.21.15.160:0/2902693180 learned_addr learned my addr 172.21.15.160:0/2902693180 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:27.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.309+0000 7f81faffd700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc158350 0x7f81fc158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.309+0000 7f81fa7fc700 1 --2- 172.21.15.160:0/2902693180 >> v2:172.21.15.171:3300/0 conn(0x7f81fc0c7400 0x7f81fc158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.309+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105478195 0 0) 0x7f81fc0c4ec0 con 0x7f81fc06a720 2022-03-21T13:54:27.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.309+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81dc0033f0 con 0x7f81fc06a720 2022-03-21T13:54:27.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2004600582 0 0) 0x7f81dc0033f0 con 0x7f81fc06a720 2022-03-21T13:54:27.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc158350 msgr2=0x7f81fc158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:27.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc158350 0x7f81fc158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 >> v2:172.21.15.171:3300/0 conn(0x7f81fc0c7400 msgr2=0x7f81fc158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:27.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 --2- 172.21.15.160:0/2902693180 >> v2:172.21.15.171:3300/0 conn(0x7f81fc0c7400 0x7f81fc158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc06a290 con 0x7f81fc06a720 2022-03-21T13:54:27.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7f81f4001470 con 0x7f81fc06a720 2022-03-21T13:54:27.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81fa7fc700 1 --2- 172.21.15.160:0/2902693180 >> v2:172.21.15.171:3300/0 conn(0x7f81fc0c7400 0x7f81fc158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:27.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 >> v1:172.21.15.160:6789/0 conn(0x7f81fc06a720 legacy=0x7f81fc0c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 0x7f81dc003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc158350 0x7f81dc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81dc004bd0 0x7f81dc005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0c53d0 con 0x7f81dc0038e0 2022-03-21T13:54:27.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc00b8e0 con 0x7f81dc004bd0 2022-03-21T13:54:27.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc00ba20 con 0x7f81fc158350 2022-03-21T13:54:27.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81faffd700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 0x7f81dc003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81fa7fc700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc158350 0x7f81dc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81fb7fe700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81dc004bd0 0x7f81dc005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81faffd700 1 -- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc158350 msgr2=0x7f81dc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:27.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81faffd700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc158350 0x7f81dc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81faffd700 1 -- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81dc004bd0 msgr2=0x7f81dc005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:27.325 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81faffd700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81dc004bd0 0x7f81dc005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.325 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81faffd700 1 -- 172.21.15.160:0/2902693180 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc0033f0 con 0x7f81dc0038e0 2022-03-21T13:54:27.325 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81fa7fc700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc158350 0x7f81dc004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:27.325 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81fb7fe700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81dc004bd0 0x7f81dc005040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:27.326 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81faffd700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 0x7f81dc003cf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00e210 tx=0x7f81ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac960727a90a0623 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:27.326 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec00ea60 con 0x7f81dc0038e0 2022-03-21T13:54:27.326 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec00f040 con 0x7f81dc0038e0 2022-03-21T13:54:27.326 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.310+0000 7f81f9ffb700 1 -- 172.21.15.160:0/2902693180 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec00ee10 con 0x7f81dc0038e0 2022-03-21T13:54:27.327 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.311+0000 7f820137f700 1 -- 172.21.15.160:0/2902693180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 msgr2=0x7f81dc003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.327 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.311+0000 7f820137f700 1 --2- 172.21.15.160:0/2902693180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 0x7f81dc003cf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00e210 tx=0x7f81ec00b040 comp rx=0 tx=0).stop 2022-03-21T13:54:27.327 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.311+0000 7f81fb7fe700 1 -- 172.21.15.160:0/2902693180 reap_dead start 2022-03-21T13:54:27.327 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.311+0000 7f820137f700 1 -- 172.21.15.160:0/2902693180 shutdown_connections 2022-03-21T13:54:27.327 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.311+0000 7f820137f700 1 -- 172.21.15.160:0/2902693180 >> 172.21.15.160:0/2902693180 conn(0x7f81fc0cb000 msgr2=0x7f81fc0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:27.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.311+0000 7f820137f700 1 -- 172.21.15.160:0/2902693180 shutdown_connections 2022-03-21T13:54:27.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.311+0000 7f820137f700 1 -- 172.21.15.160:0/2902693180 wait complete. 2022-03-21T13:54:27.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.312+0000 7f820137f700 1 Processor -- start 2022-03-21T13:54:27.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.312+0000 7f820137f700 1 -- start start 2022-03-21T13:54:27.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f820137f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 0x7f81fc06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f820137f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81fc0ca050 0x7f81fc0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f820137f700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc0ca4c0 0x7f81fc0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f820137f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc14fdd0 con 0x7f81dc0038e0 2022-03-21T13:54:27.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f820137f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc167560 con 0x7f81fc0ca050 2022-03-21T13:54:27.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f820137f700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc167800 con 0x7f81fc0ca4c0 2022-03-21T13:54:27.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81faffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 0x7f81fc06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81faffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 0x7f81fc06d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56248/0 (socket says 172.21.15.160:56248) 2022-03-21T13:54:27.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81faffd700 1 -- 172.21.15.160:0/2817915127 learned_addr learned my addr 172.21.15.160:0/2817915127 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:27.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81fa7fc700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81fc0ca050 0x7f81fc0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81fb7fe700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc0ca4c0 0x7f81fc0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81faffd700 1 -- 172.21.15.160:0/2817915127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc0ca4c0 msgr2=0x7f81fc0b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81faffd700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc0ca4c0 0x7f81fc0b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81faffd700 1 -- 172.21.15.160:0/2817915127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81fc0ca050 msgr2=0x7f81fc0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81faffd700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81fc0ca050 0x7f81fc0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81faffd700 1 -- 172.21.15.160:0/2817915127 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc167ae0 con 0x7f81dc0038e0 2022-03-21T13:54:27.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81fb7fe700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc0ca4c0 0x7f81fc0b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:27.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81faffd700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 0x7f81fc06d1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00afd0 tx=0x7f81ec01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:27.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81f2ffd700 1 -- 172.21.15.160:0/2817915127 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec004250 con 0x7f81dc0038e0 2022-03-21T13:54:27.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81f2ffd700 1 -- 172.21.15.160:0/2817915127 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec0043d0 con 0x7f81dc0038e0 2022-03-21T13:54:27.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f820137f700 1 -- 172.21.15.160:0/2817915127 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc167dc0 con 0x7f81dc0038e0 2022-03-21T13:54:27.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.313+0000 7f81f2ffd700 1 -- 172.21.15.160:0/2817915127 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec004790 con 0x7f81dc0038e0 2022-03-21T13:54:27.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.314+0000 7f820137f700 1 -- 172.21.15.160:0/2817915127 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc168380 con 0x7f81dc0038e0 2022-03-21T13:54:27.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.314+0000 7f820137f700 1 -- 172.21.15.160:0/2817915127 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc1500b0 con 0x7f81dc0038e0 2022-03-21T13:54:27.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.315+0000 7f81f2ffd700 1 -- 172.21.15.160:0/2817915127 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f81ec0148a0 con 0x7f81dc0038e0 2022-03-21T13:54:27.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.315+0000 7f81f2ffd700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f81e0063ce0 0x7f81e0066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.315+0000 7f81f2ffd700 1 -- 172.21.15.160:0/2817915127 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f81ec082dd0 con 0x7f81dc0038e0 2022-03-21T13:54:27.335 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.315+0000 7f81fa7fc700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f81e0063ce0 0x7f81e0066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.335 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.316+0000 7f81fa7fc700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f81e0063ce0 0x7f81e0066190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0c3770 tx=0x7f81e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:27.335 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.319+0000 7f81f2ffd700 1 -- 172.21.15.160:0/2817915127 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f81ec051ad0 con 0x7f81dc0038e0 2022-03-21T13:54:27.533 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.531+0000 7f820137f700 1 -- 172.21.15.160:0/2817915127 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f81fc070ae0 con 0x7f81dc0038e0 2022-03-21T13:54:27.540 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.538+0000 7f81f2ffd700 1 -- 172.21.15.160:0/2817915127 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f81ec018020 con 0x7f81dc0038e0 2022-03-21T13:54:27.543 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.541+0000 7f820137f700 1 -- 172.21.15.160:0/2817915127 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f81e0063ce0 msgr2=0x7f81e0066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.544 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.541+0000 7f820137f700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f81e0063ce0 0x7f81e0066190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0c3770 tx=0x7f81e4008040 comp rx=0 tx=0).stop 2022-03-21T13:54:27.544 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.541+0000 7f820137f700 1 -- 172.21.15.160:0/2817915127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 msgr2=0x7f81fc06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.544 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.541+0000 7f820137f700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 0x7f81fc06d1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00afd0 tx=0x7f81ec01a000 comp rx=0 tx=0).stop 2022-03-21T13:54:27.544 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.542+0000 7f820137f700 1 -- 172.21.15.160:0/2817915127 shutdown_connections 2022-03-21T13:54:27.545 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.542+0000 7f820137f700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f81e0063ce0 0x7f81e0066190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.545 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.542+0000 7f820137f700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81fc0ca4c0 0x7f81fc0b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.545 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.542+0000 7f820137f700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81dc0038e0 0x7f81fc06d1f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.545 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.542+0000 7f820137f700 1 --2- 172.21.15.160:0/2817915127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81fc0ca050 0x7f81fc0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.546 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.542+0000 7f820137f700 1 -- 172.21.15.160:0/2817915127 >> 172.21.15.160:0/2817915127 conn(0x7f81fc0cb000 msgr2=0x7f81fc153ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:27.546 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.542+0000 7f820137f700 1 -- 172.21.15.160:0/2817915127 shutdown_connections 2022-03-21T13:54:27.546 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.542+0000 7f820137f700 1 -- 172.21.15.160:0/2817915127 wait complete. 2022-03-21T13:54:27.549 INFO:teuthology.orchestra.run.smithi160.stderr:new fs with metadata pool 3 and data pool 4 2022-03-21T13:54:27.564 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-21T13:54:27.677 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.675+0000 7fd2b9faf700 1 Processor -- start 2022-03-21T13:54:27.677 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.675+0000 7fd2b9faf700 1 -- start start 2022-03-21T13:54:27.680 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.676+0000 7fd2b9faf700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd2b4067470 0x7fd2b406e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.680 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.676+0000 7fd2b9faf700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd2b4067840 0x7fd2b4151b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.680 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.676+0000 7fd2b9faf700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b40bf880 con 0x7fd2b40c2d50 2022-03-21T13:54:27.680 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.676+0000 7fd2b9faf700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b40bf3f0 con 0x7fd2b4067470 2022-03-21T13:54:27.681 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.676+0000 7fd2b9faf700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b40c5540 con 0x7fd2b4067840 2022-03-21T13:54:27.681 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.676+0000 7fd2b37fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd2b4067470 0x7fd2b406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.681 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.676+0000 7fd2b37fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd2b4067470 0x7fd2b406e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56254/0 (socket says 172.21.15.160:56254) 2022-03-21T13:54:27.681 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.676+0000 7fd2b37fe700 1 -- 172.21.15.160:0/1996771529 learned_addr learned my addr 172.21.15.160:0/1996771529 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:27.681 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b3fff700 1 --2- 172.21.15.160:0/1996771529 >> v2:172.21.15.171:3300/0 conn(0x7fd2b4067840 0x7fd2b4151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.682 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b37fe700 1 -- 172.21.15.160:0/1996771529 >> v2:172.21.15.171:3300/0 conn(0x7fd2b4067840 msgr2=0x7fd2b4151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:27.682 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b37fe700 1 --2- 172.21.15.160:0/1996771529 >> v2:172.21.15.171:3300/0 conn(0x7fd2b4067840 0x7fd2b4151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.682 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b37fe700 1 -- 172.21.15.160:0/1996771529 >> v1:172.21.15.171:6789/0 conn(0x7fd2b40c2d50 legacy=0x7fd2b40c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:27.682 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b37fe700 1 -- 172.21.15.160:0/1996771529 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b406de70 con 0x7fd2b4067470 2022-03-21T13:54:27.682 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b37fe700 1 --2- 172.21.15.160:0/1996771529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2b4067470 0x7fd2b406e540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40c3b90 tx=0x7fd2a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab3f572cea02fe1 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:27.683 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b27fc700 1 -- 172.21.15.160:0/1996771529 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40092e0 con 0x7fd2b4067470 2022-03-21T13:54:27.683 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b27fc700 1 -- 172.21.15.160:0/1996771529 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a400ba10 con 0x7fd2b4067470 2022-03-21T13:54:27.683 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b27fc700 1 -- 172.21.15.160:0/1996771529 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400bdd0 con 0x7fd2b4067470 2022-03-21T13:54:27.683 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b9faf700 1 -- 172.21.15.160:0/1996771529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2b4067470 msgr2=0x7fd2b406e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.684 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b9faf700 1 --2- 172.21.15.160:0/1996771529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2b4067470 0x7fd2b406e540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40c3b90 tx=0x7fd2a4009840 comp rx=0 tx=0).stop 2022-03-21T13:54:27.684 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b9faf700 1 -- 172.21.15.160:0/1996771529 shutdown_connections 2022-03-21T13:54:27.684 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b9faf700 1 --2- 172.21.15.160:0/1996771529 >> v2:172.21.15.171:3300/0 conn(0x7fd2b4067840 0x7fd2b4151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.684 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b9faf700 1 --2- 172.21.15.160:0/1996771529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2b4067470 0x7fd2b406e540 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.684 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b9faf700 1 -- 172.21.15.160:0/1996771529 >> 172.21.15.160:0/1996771529 conn(0x7fd2b40c87e0 msgr2=0x7fd2b40c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:27.685 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b9faf700 1 -- 172.21.15.160:0/1996771529 shutdown_connections 2022-03-21T13:54:27.685 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.677+0000 7fd2b9faf700 1 -- 172.21.15.160:0/1996771529 wait complete. 2022-03-21T13:54:27.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.679+0000 7fd2b9faf700 1 Processor -- start 2022-03-21T13:54:27.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.679+0000 7fd2b9faf700 1 -- start start 2022-03-21T13:54:27.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.679+0000 7fd2b9faf700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2b4067470 0x7fd2b406c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.679+0000 7fd2b9faf700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2b4067840 0x7fd2b40a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.679+0000 7fd2b9faf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2b40c2d50 0x7fd2b40a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.679+0000 7fd2b9faf700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b40acf10 con 0x7fd2b40c2d50 2022-03-21T13:54:27.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.679+0000 7fd2b9faf700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b40a8e70 con 0x7fd2b4067840 2022-03-21T13:54:27.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.679+0000 7fd2b9faf700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b40a9150 con 0x7fd2b4067470 2022-03-21T13:54:27.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.679+0000 7fd2b3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2b40c2d50 0x7fd2b40a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.679+0000 7fd2b3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2b40c2d50 0x7fd2b40a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56264/0 (socket says 172.21.15.160:56264) 2022-03-21T13:54:27.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.679+0000 7fd2b3fff700 1 -- 172.21.15.160:0/2691007823 learned_addr learned my addr 172.21.15.160:0/2691007823 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:27.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd2b2ffd700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2b4067840 0x7fd2b40a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd2b37fe700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2b4067470 0x7fd2b406c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd2b3fff700 1 -- 172.21.15.160:0/2691007823 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2b4067470 msgr2=0x7fd2b406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd2b3fff700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2b4067470 0x7fd2b406c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd2b3fff700 1 -- 172.21.15.160:0/2691007823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2b4067840 msgr2=0x7fd2b40a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd2b3fff700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2b4067840 0x7fd2b40a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd2b3fff700 1 -- 172.21.15.160:0/2691007823 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a4009ae0 con 0x7fd2b40c2d50 2022-03-21T13:54:27.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd2b3fff700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2b40c2d50 0x7fd2b40a5ed0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00d860 tx=0x7fd2ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:27.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd29b7fe700 1 -- 172.21.15.160:0/2691007823 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0125f0 con 0x7fd2b40c2d50 2022-03-21T13:54:27.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd29b7fe700 1 -- 172.21.15.160:0/2691007823 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac012750 con 0x7fd2b40c2d50 2022-03-21T13:54:27.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd29b7fe700 1 -- 172.21.15.160:0/2691007823 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac012b10 con 0x7fd2b40c2d50 2022-03-21T13:54:27.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd2b9faf700 1 -- 172.21.15.160:0/2691007823 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b40a9430 con 0x7fd2b40c2d50 2022-03-21T13:54:27.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.680+0000 7fd2b9faf700 1 -- 172.21.15.160:0/2691007823 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b40a99f0 con 0x7fd2b40c2d50 2022-03-21T13:54:27.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.681+0000 7fd2b9faf700 1 -- 172.21.15.160:0/2691007823 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b406fc00 con 0x7fd2b40c2d50 2022-03-21T13:54:27.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.681+0000 7fd29b7fe700 1 -- 172.21.15.160:0/2691007823 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fd2ac01e460 con 0x7fd2b40c2d50 2022-03-21T13:54:27.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.682+0000 7fd29b7fe700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd294063d10 0x7fd2940661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.682+0000 7fd29b7fe700 1 -- 172.21.15.160:0/2691007823 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd2ac080d00 con 0x7fd2b40c2d50 2022-03-21T13:54:27.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.682+0000 7fd2b37fe700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd294063d10 0x7fd2940661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.682+0000 7fd2b37fe700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd294063d10 0x7fd2940661c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009880 tx=0x7fd2a4019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:27.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.686+0000 7fd29b7fe700 1 -- 172.21.15.160:0/2691007823 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fd2ac084030 con 0x7fd2b40c2d50 2022-03-21T13:54:27.860 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.858+0000 7fd2b9faf700 1 -- 172.21.15.160:0/2691007823 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2b406e150 con 0x7fd2b40c2d50 2022-03-21T13:54:27.861 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.859+0000 7fd29b7fe700 1 -- 172.21.15.160:0/2691007823 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16906 (secure 0 0 0) 0x7fd2ac04f880 con 0x7fd2b40c2d50 2022-03-21T13:54:27.861 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:27.862 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":19,"fsid":"b2a3ddc8-064e-4cc9-8187-33ea19afd50a","created":"2022-03-21T13:54:10.384226+0000","modified":"2022-03-21T13:54:27.533427+0000","last_up_change":"2022-03-21T13:54:20.412036+0000","last_in_change":"2022-03-21T13:54:12.760084+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-03-21T13:54:21.458770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-03-21T13:54:21.499620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-21T13:54:25.482900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-21T13:54:26.501704+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"828ac39d-86ad-44a1-bb66-c99786642970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":25441},{"type":"v1","addr":"172.21.15.160:6810","nonce":25441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":25441},{"type":"v1","addr":"172.21.15.160:6814","nonce":25441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":25441},{"type":"v1","addr":"172.21.15.160:6822","nonce":25441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":25441},{"type":"v1","addr":"172.21.15.160:6818","nonce":25441}]},"public_addr":"172.21.15.160:6810/25441","cluster_addr":"172.21.15.160:6814/25441","heartbeat_back_addr":"172.21.15.160:6822/25441","heartbeat_front_addr":"172.21.15.160:6818/25441","state":["exists","up"]},{"osd":1,"uuid":"464764e2-a47e-43c0-8c93-b6bfd10ba526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":25442},{"type":"v1","addr":"172.21.15.160:6825","nonce":25442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":25442},{"type":"v1","addr":"172.21.15.160:6827","nonce":25442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":25442},{"type":"v1","addr":"172.21.15.160:6831","nonce":25442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":25442},{"type":"v1","addr":"172.21.15.160:6829","nonce":25442}]},"public_addr":"172.21.15.160:6825/25442","cluster_addr":"172.21.15.160:6827/25442","heartbeat_back_addr":"172.21.15.160:6831/25442","heartbeat_front_addr":"172.21.15.160:6829/25442","state":["exists","up"]},{"osd":2,"uuid":"4dbfea57-14b6-4c67-8312-fc7d71ef77a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":25443},{"type":"v1","addr":"172.21.15.160:6811","nonce":25443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6813","nonce":25443},{"type":"v1","addr":"172.21.15.160:6815","nonce":25443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":25443},{"type":"v1","addr":"172.21.15.160:6823","nonce":25443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":25443},{"type":"v1","addr":"172.21.15.160:6819","nonce":25443}]},"public_addr":"172.21.15.160:6811/25443","cluster_addr":"172.21.15.160:6815/25443","heartbeat_back_addr":"172.21.15.160:6823/25443","heartbeat_front_addr":"172.21.15.160:6819/25443","state":["exists","up"]},{"osd":3,"uuid":"c53ed58d-a1f3-4783-8677-9348a1d103f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":25440},{"type":"v1","addr":"172.21.15.160:6801","nonce":25440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":25440},{"type":"v1","addr":"172.21.15.160:6803","nonce":25440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":25440},{"type":"v1","addr":"172.21.15.160:6807","nonce":25440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":25440},{"type":"v1","addr":"172.21.15.160:6805","nonce":25440}]},"public_addr":"172.21.15.160:6801/25440","cluster_addr":"172.21.15.160:6803/25440","heartbeat_back_addr":"172.21.15.160:6807/25440","heartbeat_front_addr":"172.21.15.160:6805/25440","state":["exists","up"]},{"osd":4,"uuid":"5713dbd4-1736-4ebf-8102-e80f4db6bcc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":25559},{"type":"v1","addr":"172.21.15.171:6817","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":25559},{"type":"v1","addr":"172.21.15.171:6819","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":25559},{"type":"v1","addr":"172.21.15.171:6826","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":25559},{"type":"v1","addr":"172.21.15.171:6821","nonce":25559}]},"public_addr":"172.21.15.171:6817/25559","cluster_addr":"172.21.15.171:6819/25559","heartbeat_back_addr":"172.21.15.171:6826/25559","heartbeat_front_addr":"172.21.15.171:6821/25559","state":["exists","up"]},{"osd":5,"uuid":"dfe21128-6ae6-4662-9f47-1bbb423a2232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":25549},{"type":"v1","addr":"172.21.15.171:6801","nonce":25549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":25549},{"type":"v1","addr":"172.21.15.171:6803","nonce":25549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":25549},{"type":"v1","addr":"172.21.15.171:6807","nonce":25549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":25549},{"type":"v1","addr":"172.21.15.171:6805","nonce":25549}]},"public_addr":"172.21.15.171:6801/25549","cluster_addr":"172.21.15.171:6803/25549","heartbeat_back_addr":"172.21.15.171:6807/25549","heartbeat_front_addr":"172.21.15.171:6805/25549","state":["exists","up"]},{"osd":6,"uuid":"24a9b956-5fa1-41bf-a689-0f048b7f19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":25574},{"type":"v1","addr":"172.21.15.171:6823","nonce":25574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":25574},{"type":"v1","addr":"172.21.15.171:6827","nonce":25574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":25574},{"type":"v1","addr":"172.21.15.171:6831","nonce":25574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":25574},{"type":"v1","addr":"172.21.15.171:6829","nonce":25574}]},"public_addr":"172.21.15.171:6823/25574","cluster_addr":"172.21.15.171:6827/25574","heartbeat_back_addr":"172.21.15.171:6831/25574","heartbeat_front_addr":"172.21.15.171:6829/25574","state":["exists","up"]},{"osd":7,"uuid":"a5ab4a14-8a7b-43b8-932c-a950f81c10f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":25550},{"type":"v1","addr":"172.21.15.171:6809","nonce":25550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":25550},{"type":"v1","addr":"172.21.15.171:6811","nonce":25550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":25550},{"type":"v1","addr":"172.21.15.171:6815","nonce":25550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":25550},{"type":"v1","addr":"172.21.15.171:6813","nonce":25550}]},"public_addr":"172.21.15.171:6809/25550","cluster_addr":"172.21.15.171:6811/25550","heartbeat_back_addr":"172.21.15.171:6815/25550","heartbeat_front_addr":"172.21.15.171:6813/25550","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.888796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.906098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.896027+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.876694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954695+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.846031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.883631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-21T13:54:27.863 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.861+0000 7fd2b9faf700 1 -- 172.21.15.160:0/2691007823 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd294063d10 msgr2=0x7fd2940661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.861+0000 7fd2b9faf700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd294063d10 0x7fd2940661c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009880 tx=0x7fd2a4019000 comp rx=0 tx=0).stop 2022-03-21T13:54:27.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.861+0000 7fd2b9faf700 1 -- 172.21.15.160:0/2691007823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2b40c2d50 msgr2=0x7fd2b40a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.861+0000 7fd2b9faf700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2b40c2d50 0x7fd2b40a5ed0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00d860 tx=0x7fd2ac008040 comp rx=0 tx=0).stop 2022-03-21T13:54:27.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.861+0000 7fd2b9faf700 1 -- 172.21.15.160:0/2691007823 shutdown_connections 2022-03-21T13:54:27.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.861+0000 7fd2b9faf700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd294063d10 0x7fd2940661c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.861+0000 7fd2b9faf700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2b40c2d50 0x7fd2b40a5ed0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.861+0000 7fd2b9faf700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2b4067470 0x7fd2b406c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.861+0000 7fd2b9faf700 1 --2- 172.21.15.160:0/2691007823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2b4067840 0x7fd2b40a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.861+0000 7fd2b9faf700 1 -- 172.21.15.160:0/2691007823 >> 172.21.15.160:0/2691007823 conn(0x7fd2b40c87e0 msgr2=0x7fd2b40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:27.866 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.862+0000 7fd2b9faf700 1 -- 172.21.15.160:0/2691007823 shutdown_connections 2022-03-21T13:54:27.866 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.862+0000 7fd2b9faf700 1 -- 172.21.15.160:0/2691007823 wait complete. 2022-03-21T13:54:27.875 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-21T13:54:27.988 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.986+0000 7ff2562c3700 1 Processor -- start 2022-03-21T13:54:27.988 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.987+0000 7ff2562c3700 1 -- start start 2022-03-21T13:54:27.991 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.987+0000 7ff2562c3700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157640 0x7ff250157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.991 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.987+0000 7ff2562c3700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff25006d190 0x7ff250158450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:27.991 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.987+0000 7ff2562c3700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff250158e30 con 0x7ff250157a10 2022-03-21T13:54:27.992 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.987+0000 7ff2562c3700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25006baa0 con 0x7ff25006d190 2022-03-21T13:54:27.992 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.987+0000 7ff2562c3700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500c6d80 con 0x7ff250157640 2022-03-21T13:54:27.992 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24ffff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157640 0x7ff250157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.992 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff254860700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff25006d190 0x7ff250158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:27.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24ffff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157640 0x7ff250157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:46664/0 (socket says 172.21.15.160:46664) 2022-03-21T13:54:27.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24ffff700 1 -- 172.21.15.160:0/1818642269 learned_addr learned my addr 172.21.15.160:0/1818642269 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:27.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24f7fe700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff250157a10 0x7ff25006ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:52512/0 (socket says 172.21.15.160:52512) 2022-03-21T13:54:27.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24ffff700 1 -- 172.21.15.160:0/1818642269 >> v2:172.21.15.171:3300/0 conn(0x7ff25006d190 msgr2=0x7ff250158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:27.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24ffff700 1 --2- 172.21.15.160:0/1818642269 >> v2:172.21.15.171:3300/0 conn(0x7ff25006d190 0x7ff250158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24ffff700 1 -- 172.21.15.160:0/1818642269 >> v1:172.21.15.171:6789/0 conn(0x7ff250157a10 legacy=0x7ff25006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24ffff700 1 -- 172.21.15.160:0/1818642269 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff250158b50 con 0x7ff250157640 2022-03-21T13:54:27.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff254860700 1 --2- 172.21.15.160:0/1818642269 >> v2:172.21.15.171:3300/0 conn(0x7ff25006d190 0x7ff250158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:27.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24ffff700 1 --2- 172.21.15.160:0/1818642269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157640 0x7ff250157f10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff240009830 tx=0x7ff2400090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=515bd4e7827f5b78 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:27.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24effd700 1 -- 172.21.15.160:0/1818642269 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff240004030 con 0x7ff250157640 2022-03-21T13:54:27.995 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24effd700 1 -- 172.21.15.160:0/1818642269 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff240004190 con 0x7ff250157640 2022-03-21T13:54:27.995 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.988+0000 7ff24effd700 1 -- 172.21.15.160:0/1818642269 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff240011630 con 0x7ff250157640 2022-03-21T13:54:27.995 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.989+0000 7ff2562c3700 1 -- 172.21.15.160:0/1818642269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157640 msgr2=0x7ff250157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:27.995 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.989+0000 7ff2562c3700 1 --2- 172.21.15.160:0/1818642269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157640 0x7ff250157f10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff240009830 tx=0x7ff2400090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.996 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.989+0000 7ff2562c3700 1 -- 172.21.15.160:0/1818642269 shutdown_connections 2022-03-21T13:54:27.996 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.989+0000 7ff2562c3700 1 --2- 172.21.15.160:0/1818642269 >> v2:172.21.15.171:3300/0 conn(0x7ff25006d190 0x7ff250158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.996 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.989+0000 7ff2562c3700 1 --2- 172.21.15.160:0/1818642269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157640 0x7ff250157f10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:27.996 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.989+0000 7ff2562c3700 1 -- 172.21.15.160:0/1818642269 >> 172.21.15.160:0/1818642269 conn(0x7ff250068620 msgr2=0x7ff2500cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:27.996 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.989+0000 7ff2562c3700 1 -- 172.21.15.160:0/1818642269 shutdown_connections 2022-03-21T13:54:27.997 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.989+0000 7ff2562c3700 1 -- 172.21.15.160:0/1818642269 wait complete. 2022-03-21T13:54:28.000 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.990+0000 7ff2562c3700 1 Processor -- start 2022-03-21T13:54:28.000 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.990+0000 7ff2562c3700 1 -- start start 2022-03-21T13:54:28.000 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff2562c3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff25006d190 0x7ff2500bd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:28.000 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff2562c3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff250157640 0x7ff2500c0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:28.001 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff2562c3700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157a10 0x7ff2500c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:28.001 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff2562c3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff250165270 con 0x7ff250157640 2022-03-21T13:54:28.001 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff2562c3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500c04a0 con 0x7ff25006d190 2022-03-21T13:54:28.001 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff2562c3700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500c9210 con 0x7ff250157a10 2022-03-21T13:54:28.001 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff24f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff250157640 0x7ff2500c0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:28.002 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff24f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff250157640 0x7ff2500c0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56276/0 (socket says 172.21.15.160:56276) 2022-03-21T13:54:28.002 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff24f7fe700 1 -- 172.21.15.160:0/2392384068 learned_addr learned my addr 172.21.15.160:0/2392384068 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:28.002 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff254860700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157a10 0x7ff2500c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:28.002 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff24ffff700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff25006d190 0x7ff2500bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:28.003 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff24f7fe700 1 -- 172.21.15.160:0/2392384068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157a10 msgr2=0x7ff2500c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:28.003 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff24f7fe700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157a10 0x7ff2500c0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:28.003 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff24f7fe700 1 -- 172.21.15.160:0/2392384068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff25006d190 msgr2=0x7ff2500bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:28.003 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff24f7fe700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff25006d190 0x7ff2500bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:28.003 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff24f7fe700 1 -- 172.21.15.160:0/2392384068 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff248009a20 con 0x7ff250157640 2022-03-21T13:54:28.004 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.991+0000 7ff24f7fe700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff250157640 0x7ff2500c0930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff24400c470 tx=0x7ff244007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:28.004 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.992+0000 7ff237fff700 1 -- 172.21.15.160:0/2392384068 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2440070d0 con 0x7ff250157640 2022-03-21T13:54:28.004 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.992+0000 7ff237fff700 1 -- 172.21.15.160:0/2392384068 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff244007230 con 0x7ff250157640 2022-03-21T13:54:28.004 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.992+0000 7ff2562c3700 1 -- 172.21.15.160:0/2392384068 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff240009370 con 0x7ff250157640 2022-03-21T13:54:28.004 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.992+0000 7ff237fff700 1 -- 172.21.15.160:0/2392384068 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2440046b0 con 0x7ff250157640 2022-03-21T13:54:28.005 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.992+0000 7ff2562c3700 1 -- 172.21.15.160:0/2392384068 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2500bfe50 con 0x7ff250157640 2022-03-21T13:54:28.005 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.993+0000 7ff2562c3700 1 -- 172.21.15.160:0/2392384068 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2500c0610 con 0x7ff250157640 2022-03-21T13:54:28.005 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.993+0000 7ff237fff700 1 -- 172.21.15.160:0/2392384068 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7ff244010070 con 0x7ff250157640 2022-03-21T13:54:28.005 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.993+0000 7ff237fff700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ff230063ce0 0x7ff230066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:28.005 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.993+0000 7ff237fff700 1 -- 172.21.15.160:0/2392384068 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff24407f790 con 0x7ff250157640 2022-03-21T13:54:28.006 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.993+0000 7ff24ffff700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ff230063ce0 0x7ff230066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:28.006 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.994+0000 7ff24ffff700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ff230063ce0 0x7ff230066190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff240009830 tx=0x7ff240016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:28.006 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:27.998+0000 7ff237fff700 1 -- 172.21.15.160:0/2392384068 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7ff24404e310 con 0x7ff250157640 2022-03-21T13:54:28.172 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.170+0000 7ff2562c3700 1 -- 172.21.15.160:0/2392384068 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff250156f30 con 0x7ff250157640 2022-03-21T13:54:28.172 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.171+0000 7ff237fff700 1 -- 172.21.15.160:0/2392384068 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16906 (secure 0 0 0) 0x7ff244051930 con 0x7ff250157640 2022-03-21T13:54:28.173 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:28.173 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":19,"fsid":"b2a3ddc8-064e-4cc9-8187-33ea19afd50a","created":"2022-03-21T13:54:10.384226+0000","modified":"2022-03-21T13:54:27.533427+0000","last_up_change":"2022-03-21T13:54:20.412036+0000","last_in_change":"2022-03-21T13:54:12.760084+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-03-21T13:54:21.458770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-03-21T13:54:21.499620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-21T13:54:25.482900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-21T13:54:26.501704+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"828ac39d-86ad-44a1-bb66-c99786642970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":25441},{"type":"v1","addr":"172.21.15.160:6810","nonce":25441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":25441},{"type":"v1","addr":"172.21.15.160:6814","nonce":25441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":25441},{"type":"v1","addr":"172.21.15.160:6822","nonce":25441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":25441},{"type":"v1","addr":"172.21.15.160:6818","nonce":25441}]},"public_addr":"172.21.15.160:6810/25441","cluster_addr":"172.21.15.160:6814/25441","heartbeat_back_addr":"172.21.15.160:6822/25441","heartbeat_front_addr":"172.21.15.160:6818/25441","state":["exists","up"]},{"osd":1,"uuid":"464764e2-a47e-43c0-8c93-b6bfd10ba526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":25442},{"type":"v1","addr":"172.21.15.160:6825","nonce":25442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":25442},{"type":"v1","addr":"172.21.15.160:6827","nonce":25442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":25442},{"type":"v1","addr":"172.21.15.160:6831","nonce":25442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":25442},{"type":"v1","addr":"172.21.15.160:6829","nonce":25442}]},"public_addr":"172.21.15.160:6825/25442","cluster_addr":"172.21.15.160:6827/25442","heartbeat_back_addr":"172.21.15.160:6831/25442","heartbeat_front_addr":"172.21.15.160:6829/25442","state":["exists","up"]},{"osd":2,"uuid":"4dbfea57-14b6-4c67-8312-fc7d71ef77a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":25443},{"type":"v1","addr":"172.21.15.160:6811","nonce":25443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6813","nonce":25443},{"type":"v1","addr":"172.21.15.160:6815","nonce":25443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":25443},{"type":"v1","addr":"172.21.15.160:6823","nonce":25443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":25443},{"type":"v1","addr":"172.21.15.160:6819","nonce":25443}]},"public_addr":"172.21.15.160:6811/25443","cluster_addr":"172.21.15.160:6815/25443","heartbeat_back_addr":"172.21.15.160:6823/25443","heartbeat_front_addr":"172.21.15.160:6819/25443","state":["exists","up"]},{"osd":3,"uuid":"c53ed58d-a1f3-4783-8677-9348a1d103f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":25440},{"type":"v1","addr":"172.21.15.160:6801","nonce":25440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":25440},{"type":"v1","addr":"172.21.15.160:6803","nonce":25440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":25440},{"type":"v1","addr":"172.21.15.160:6807","nonce":25440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":25440},{"type":"v1","addr":"172.21.15.160:6805","nonce":25440}]},"public_addr":"172.21.15.160:6801/25440","cluster_addr":"172.21.15.160:6803/25440","heartbeat_back_addr":"172.21.15.160:6807/25440","heartbeat_front_addr":"172.21.15.160:6805/25440","state":["exists","up"]},{"osd":4,"uuid":"5713dbd4-1736-4ebf-8102-e80f4db6bcc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":25559},{"type":"v1","addr":"172.21.15.171:6817","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":25559},{"type":"v1","addr":"172.21.15.171:6819","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":25559},{"type":"v1","addr":"172.21.15.171:6826","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":25559},{"type":"v1","addr":"172.21.15.171:6821","nonce":25559}]},"public_addr":"172.21.15.171:6817/25559","cluster_addr":"172.21.15.171:6819/25559","heartbeat_back_addr":"172.21.15.171:6826/25559","heartbeat_front_addr":"172.21.15.171:6821/25559","state":["exists","up"]},{"osd":5,"uuid":"dfe21128-6ae6-4662-9f47-1bbb423a2232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":25549},{"type":"v1","addr":"172.21.15.171:6801","nonce":25549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":25549},{"type":"v1","addr":"172.21.15.171:6803","nonce":25549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":25549},{"type":"v1","addr":"172.21.15.171:6807","nonce":25549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":25549},{"type":"v1","addr":"172.21.15.171:6805","nonce":25549}]},"public_addr":"172.21.15.171:6801/25549","cluster_addr":"172.21.15.171:6803/25549","heartbeat_back_addr":"172.21.15.171:6807/25549","heartbeat_front_addr":"172.21.15.171:6805/25549","state":["exists","up"]},{"osd":6,"uuid":"24a9b956-5fa1-41bf-a689-0f048b7f19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":25574},{"type":"v1","addr":"172.21.15.171:6823","nonce":25574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":25574},{"type":"v1","addr":"172.21.15.171:6827","nonce":25574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":25574},{"type":"v1","addr":"172.21.15.171:6831","nonce":25574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":25574},{"type":"v1","addr":"172.21.15.171:6829","nonce":25574}]},"public_addr":"172.21.15.171:6823/25574","cluster_addr":"172.21.15.171:6827/25574","heartbeat_back_addr":"172.21.15.171:6831/25574","heartbeat_front_addr":"172.21.15.171:6829/25574","state":["exists","up"]},{"osd":7,"uuid":"a5ab4a14-8a7b-43b8-932c-a950f81c10f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":25550},{"type":"v1","addr":"172.21.15.171:6809","nonce":25550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":25550},{"type":"v1","addr":"172.21.15.171:6811","nonce":25550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":25550},{"type":"v1","addr":"172.21.15.171:6815","nonce":25550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":25550},{"type":"v1","addr":"172.21.15.171:6813","nonce":25550}]},"public_addr":"172.21.15.171:6809/25550","cluster_addr":"172.21.15.171:6811/25550","heartbeat_back_addr":"172.21.15.171:6815/25550","heartbeat_front_addr":"172.21.15.171:6813/25550","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.888796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.906098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.896027+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.876694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954695+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.846031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.883631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-21T13:54:28.175 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 -- 172.21.15.160:0/2392384068 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ff230063ce0 msgr2=0x7ff230066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:28.175 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ff230063ce0 0x7ff230066190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff240009830 tx=0x7ff240016000 comp rx=0 tx=0).stop 2022-03-21T13:54:28.175 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 -- 172.21.15.160:0/2392384068 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff250157640 msgr2=0x7ff2500c0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:28.176 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff250157640 0x7ff2500c0930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff24400c470 tx=0x7ff244007d80 comp rx=0 tx=0).stop 2022-03-21T13:54:28.176 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 -- 172.21.15.160:0/2392384068 shutdown_connections 2022-03-21T13:54:28.176 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ff230063ce0 0x7ff230066190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:28.176 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff250157a10 0x7ff2500c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:28.177 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff25006d190 0x7ff2500bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:28.177 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 --2- 172.21.15.160:0/2392384068 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff250157640 0x7ff2500c0930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:28.177 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 -- 172.21.15.160:0/2392384068 >> 172.21.15.160:0/2392384068 conn(0x7ff250068620 msgr2=0x7ff2500cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:28.177 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 -- 172.21.15.160:0/2392384068 shutdown_connections 2022-03-21T13:54:28.177 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.173+0000 7ff2562c3700 1 -- 172.21.15.160:0/2392384068 wait complete. 2022-03-21T13:54:28.187 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-03-21T13:54:28.303 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.301+0000 7f2a718f6700 1 Processor -- start 2022-03-21T13:54:28.304 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.301+0000 7f2a718f6700 1 -- start start 2022-03-21T13:54:28.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.302+0000 7f2a718f6700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6c0bf3d0 0x7f2a6c0c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:28.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.302+0000 7f2a718f6700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2a6c06c6c0 0x7f2a6c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:28.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.302+0000 7f2a718f6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6c0c1830 con 0x7f2a6c0c2e10 2022-03-21T13:54:28.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.302+0000 7f2a718f6700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6c0c1cc0 con 0x7f2a6c06c6c0 2022-03-21T13:54:28.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.302+0000 7f2a718f6700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c06c230 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.302+0000 7f2a6b7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2a6c06c6c0 0x7f2a6c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:28.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.302+0000 7f2a6a7fc700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f2a6c0c2e10 0x7f2a6c0c4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59436/0 (socket says 172.21.15.160:59436) 2022-03-21T13:54:28.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.302+0000 7f2a6b7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2a6c06c6c0 0x7f2a6c06cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56286/0 (socket says 172.21.15.160:56286) 2022-03-21T13:54:28.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.302+0000 7f2a6a7fc700 1 -- 172.21.15.160:0/559044817 learned_addr learned my addr 172.21.15.160:0/559044817 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:28.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a6affd700 1 --2- 172.21.15.160:0/559044817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6c0bf3d0 0x7f2a6c0c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:28.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a6b7fe700 1 -- 172.21.15.160:0/559044817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6c0bf3d0 msgr2=0x7f2a6c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:28.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a6b7fe700 1 --2- 172.21.15.160:0/559044817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6c0bf3d0 0x7f2a6c0c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:28.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a6b7fe700 1 -- 172.21.15.160:0/559044817 >> v1:172.21.15.160:6789/0 conn(0x7f2a6c0c2e10 legacy=0x7f2a6c0c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:28.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a6b7fe700 1 -- 172.21.15.160:0/559044817 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c06d080 con 0x7f2a6c06c6c0 2022-03-21T13:54:28.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a6b7fe700 1 --2- 172.21.15.160:0/559044817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c06c6c0 0x7f2a6c06cb40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009760 tx=0x7f2a64009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b30b5acc94ab92 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:28.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a69ffb700 1 -- 172.21.15.160:0/559044817 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64011630 con 0x7f2a6c06c6c0 2022-03-21T13:54:28.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a69ffb700 1 -- 172.21.15.160:0/559044817 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a64011790 con 0x7f2a6c06c6c0 2022-03-21T13:54:28.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a69ffb700 1 -- 172.21.15.160:0/559044817 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64011b30 con 0x7f2a6c06c6c0 2022-03-21T13:54:28.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a718f6700 1 -- 172.21.15.160:0/559044817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c06c6c0 msgr2=0x7f2a6c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:28.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a718f6700 1 --2- 172.21.15.160:0/559044817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c06c6c0 0x7f2a6c06cb40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009760 tx=0x7f2a64009060 comp rx=0 tx=0).stop 2022-03-21T13:54:28.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a718f6700 1 -- 172.21.15.160:0/559044817 shutdown_connections 2022-03-21T13:54:28.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a718f6700 1 --2- 172.21.15.160:0/559044817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c06c6c0 0x7f2a6c06cb40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:28.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a718f6700 1 --2- 172.21.15.160:0/559044817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6c0bf3d0 0x7f2a6c0c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:28.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a718f6700 1 -- 172.21.15.160:0/559044817 >> 172.21.15.160:0/559044817 conn(0x7f2a6c0c9910 msgr2=0x7f2a6c0c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:28.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a718f6700 1 -- 172.21.15.160:0/559044817 shutdown_connections 2022-03-21T13:54:28.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.303+0000 7f2a718f6700 1 -- 172.21.15.160:0/559044817 wait complete. 2022-03-21T13:54:28.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.305+0000 7f2a718f6700 1 Processor -- start 2022-03-21T13:54:28.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.305+0000 7f2a718f6700 1 -- start start 2022-03-21T13:54:28.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.305+0000 7f2a718f6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a6c06c6c0 0x7f2a6c1639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:28.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.305+0000 7f2a718f6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c0bf3d0 0x7f2a6c153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:28.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.305+0000 7f2a718f6700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6c0c2e10 0x7f2a6c151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:28.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.305+0000 7f2a718f6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c153720 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.305+0000 7f2a718f6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c153a00 con 0x7f2a6c06c6c0 2022-03-21T13:54:28.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.305+0000 7f2a718f6700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c153ce0 con 0x7f2a6c0c2e10 2022-03-21T13:54:28.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.305+0000 7f2a6a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c0bf3d0 0x7f2a6c153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:28.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a6a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c0bf3d0 0x7f2a6c153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56290/0 (socket says 172.21.15.160:56290) 2022-03-21T13:54:28.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a6a7fc700 1 -- 172.21.15.160:0/2316803101 learned_addr learned my addr 172.21.15.160:0/2316803101 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:28.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a6a7fc700 1 -- 172.21.15.160:0/2316803101 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6c0c2e10 msgr2=0x7f2a6c151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:28.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a6a7fc700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6c0c2e10 0x7f2a6c151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:28.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a6a7fc700 1 -- 172.21.15.160:0/2316803101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a6c06c6c0 msgr2=0x7f2a6c1639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:28.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a6a7fc700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a6c06c6c0 0x7f2a6c1639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:28.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a6a7fc700 1 -- 172.21.15.160:0/2316803101 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a640092a0 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a6a7fc700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c0bf3d0 0x7f2a6c153100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c4c0 tx=0x7f2a54007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:28.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a62ffd700 1 -- 172.21.15.160:0/2316803101 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540073b0 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a62ffd700 1 -- 172.21.15.160:0/2316803101 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a54007510 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a718f6700 1 -- 172.21.15.160:0/2316803101 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6c1631f0 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a62ffd700 1 -- 172.21.15.160:0/2316803101 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54005260 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.306+0000 7f2a718f6700 1 -- 172.21.15.160:0/2316803101 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c156cf0 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.307+0000 7f2a718f6700 1 -- 172.21.15.160:0/2316803101 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6c0c3530 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.307+0000 7f2a62ffd700 1 -- 172.21.15.160:0/2316803101 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f2a54010070 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.308+0000 7f2a62ffd700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f2a50063ce0 0x7f2a50066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:28.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.308+0000 7f2a62ffd700 1 -- 172.21.15.160:0/2316803101 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2a54080060 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.308+0000 7f2a6affd700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f2a50063ce0 0x7f2a50066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:28.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.308+0000 7f2a6affd700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f2a50063ce0 0x7f2a50066190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c007460 tx=0x7f2a5c009a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:28.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.312+0000 7f2a62ffd700 1 -- 172.21.15.160:0/2316803101 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f2a5404ec40 con 0x7f2a6c0bf3d0 2022-03-21T13:54:28.524 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:28.523+0000 7f2a718f6700 1 -- 172.21.15.160:0/2316803101 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2a6c0c3f50 con 0x7f2a6c0bf3d0 2022-03-21T13:54:29.191 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.189+0000 7f2a62ffd700 1 -- 172.21.15.160:0/2316803101 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2a54052260 con 0x7f2a6c0bf3d0 2022-03-21T13:54:29.194 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 -- 172.21.15.160:0/2316803101 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f2a50063ce0 msgr2=0x7f2a50066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:29.194 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f2a50063ce0 0x7f2a50066190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c007460 tx=0x7f2a5c009a10 comp rx=0 tx=0).stop 2022-03-21T13:54:29.194 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 -- 172.21.15.160:0/2316803101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c0bf3d0 msgr2=0x7f2a6c153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:29.195 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c0bf3d0 0x7f2a6c153100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c4c0 tx=0x7f2a54007dc0 comp rx=0 tx=0).stop 2022-03-21T13:54:29.195 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 -- 172.21.15.160:0/2316803101 shutdown_connections 2022-03-21T13:54:29.195 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f2a50063ce0 0x7f2a50066190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:29.195 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6c0c2e10 0x7f2a6c151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:29.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a6c06c6c0 0x7f2a6c1639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:29.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 --2- 172.21.15.160:0/2316803101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c0bf3d0 0x7f2a6c153100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:29.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 -- 172.21.15.160:0/2316803101 >> 172.21.15.160:0/2316803101 conn(0x7f2a6c0c9910 msgr2=0x7f2a6c1584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:29.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 -- 172.21.15.160:0/2316803101 shutdown_connections 2022-03-21T13:54:29.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.192+0000 7f2a718f6700 1 -- 172.21.15.160:0/2316803101 wait complete. 2022-03-21T13:54:29.207 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2022-03-21T13:54:29.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.323+0000 7f500ef61700 1 Processor -- start 2022-03-21T13:54:29.325 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.323+0000 7f500ef61700 1 -- start start 2022-03-21T13:54:29.327 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.323+0000 7f500ef61700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f500806ae30 0x7f50080c4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:29.327 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.323+0000 7f500ef61700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080c4ec0 con 0x7f5008158350 2022-03-21T13:54:29.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.323+0000 7f500ef61700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080c53d0 con 0x7f50080c7400 2022-03-21T13:54:29.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.323+0000 7f500ef61700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080c5a10 con 0x7f500806ae30 2022-03-21T13:54:29.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.323+0000 7f500d4fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f500806ae30 0x7f50080c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:29.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.323+0000 7f500ccfd700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f5008158350 0x7f5008158720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59448/0 (socket says 172.21.15.160:59448) 2022-03-21T13:54:29.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.323+0000 7f500ccfd700 1 -- 172.21.15.160:0/3073558595 learned_addr learned my addr 172.21.15.160:0/3073558595 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:29.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.324+0000 7f500d4fe700 1 -- 172.21.15.160:0/3073558595 >> v1:172.21.15.171:6789/0 conn(0x7f50080c7400 legacy=0x7f500806a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:29.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.324+0000 7f500d4fe700 1 -- 172.21.15.160:0/3073558595 >> v1:172.21.15.160:6789/0 conn(0x7f5008158350 legacy=0x7f5008158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:29.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.324+0000 7f50077fe700 1 -- 172.21.15.160:0/3073558595 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391861678 0 0) 0x7f50080c4ec0 con 0x7f5008158350 2022-03-21T13:54:29.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.324+0000 7f500d4fe700 1 -- 172.21.15.160:0/3073558595 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500806a290 con 0x7f500806ae30 2022-03-21T13:54:29.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.324+0000 7f500d4fe700 1 --2- 172.21.15.160:0/3073558595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f500806ae30 0x7f50080c4110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5000009e60 tx=0x7f5000009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2155463c4626bf server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:29.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.324+0000 7f50077fe700 1 -- 172.21.15.160:0/3073558595 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000e070 con 0x7f500806ae30 2022-03-21T13:54:29.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.324+0000 7f50077fe700 1 -- 172.21.15.160:0/3073558595 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500000bc30 con 0x7f500806ae30 2022-03-21T13:54:29.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.324+0000 7f50077fe700 1 -- 172.21.15.160:0/3073558595 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000003860 con 0x7f500806ae30 2022-03-21T13:54:29.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.324+0000 7f500ef61700 1 -- 172.21.15.160:0/3073558595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f500806ae30 msgr2=0x7f50080c4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:29.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.324+0000 7f500ef61700 1 --2- 172.21.15.160:0/3073558595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f500806ae30 0x7f50080c4110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5000009e60 tx=0x7f5000009780 comp rx=0 tx=0).stop 2022-03-21T13:54:29.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.324+0000 7f500ef61700 1 -- 172.21.15.160:0/3073558595 shutdown_connections 2022-03-21T13:54:29.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.325+0000 7f500ef61700 1 --2- 172.21.15.160:0/3073558595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f500806ae30 0x7f50080c4110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:29.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.325+0000 7f500ef61700 1 -- 172.21.15.160:0/3073558595 >> 172.21.15.160:0/3073558595 conn(0x7f50080cb000 msgr2=0x7f50080cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:29.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.325+0000 7f500ef61700 1 -- 172.21.15.160:0/3073558595 shutdown_connections 2022-03-21T13:54:29.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.325+0000 7f500ef61700 1 -- 172.21.15.160:0/3073558595 wait complete. 2022-03-21T13:54:29.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.326+0000 7f500ef61700 1 Processor -- start 2022-03-21T13:54:29.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.326+0000 7f500ef61700 1 -- start start 2022-03-21T13:54:29.335 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.326+0000 7f500ef61700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f500806ae30 0x7f50081590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:29.335 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.326+0000 7f500ef61700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50080c7400 0x7f50080c1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:29.335 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.326+0000 7f500ef61700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5008158350 0x7f500815b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:29.336 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.326+0000 7f500ef61700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500815af90 con 0x7f50080c7400 2022-03-21T13:54:29.336 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.326+0000 7f500ef61700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008159ed0 con 0x7f5008158350 2022-03-21T13:54:29.336 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.326+0000 7f500ef61700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080a88f0 con 0x7f500806ae30 2022-03-21T13:54:29.336 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.326+0000 7f5007fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50080c7400 0x7f50080c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:29.337 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f5007fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50080c7400 0x7f50080c1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56304/0 (socket says 172.21.15.160:56304) 2022-03-21T13:54:29.337 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f5007fff700 1 -- 172.21.15.160:0/4041165080 learned_addr learned my addr 172.21.15.160:0/4041165080 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:29.337 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f500d4fe700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5008158350 0x7f500815b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:29.337 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f500ccfd700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f500806ae30 0x7f50081590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:29.337 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f5007fff700 1 -- 172.21.15.160:0/4041165080 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f500806ae30 msgr2=0x7f50081590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:29.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f5007fff700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f500806ae30 0x7f50081590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:29.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f5007fff700 1 -- 172.21.15.160:0/4041165080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5008158350 msgr2=0x7f500815b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:29.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f5007fff700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5008158350 0x7f500815b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:29.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f5007fff700 1 -- 172.21.15.160:0/4041165080 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5000009a20 con 0x7f50080c7400 2022-03-21T13:54:29.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f5007fff700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50080c7400 0x7f50080c1960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c440 tx=0x7f4ffc007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:29.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f5004ff9700 1 -- 172.21.15.160:0/4041165080 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00ce80 con 0x7f50080c7400 2022-03-21T13:54:29.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f5004ff9700 1 -- 172.21.15.160:0/4041165080 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc011590 con 0x7f50080c7400 2022-03-21T13:54:29.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f500ef61700 1 -- 172.21.15.160:0/4041165080 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5008159910 con 0x7f50080c7400 2022-03-21T13:54:29.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f5004ff9700 1 -- 172.21.15.160:0/4041165080 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc011930 con 0x7f50080c7400 2022-03-21T13:54:29.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.327+0000 7f500ef61700 1 -- 172.21.15.160:0/4041165080 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500815a940 con 0x7f50080c7400 2022-03-21T13:54:29.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.328+0000 7f500ef61700 1 -- 172.21.15.160:0/4041165080 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5008070ae0 con 0x7f50080c7400 2022-03-21T13:54:29.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.328+0000 7f5004ff9700 1 -- 172.21.15.160:0/4041165080 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f4ffc010050 con 0x7f50080c7400 2022-03-21T13:54:29.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.329+0000 7f5004ff9700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4fe8063ce0 0x7f4fe8066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:29.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.329+0000 7f5004ff9700 1 -- 172.21.15.160:0/4041165080 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ffc0802c0 con 0x7f50080c7400 2022-03-21T13:54:29.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.329+0000 7f500ccfd700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4fe8063ce0 0x7f4fe8066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:29.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.329+0000 7f500ccfd700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4fe8063ce0 0x7f4fe8066190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80047d0 tx=0x7f4ff8007bb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:29.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.333+0000 7f5004ff9700 1 -- 172.21.15.160:0/4041165080 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f4ffc04eea0 con 0x7f50080c7400 2022-03-21T13:54:29.545 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:29.543+0000 7f500ef61700 1 -- 172.21.15.160:0/4041165080 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f50080c6700 con 0x7f50080c7400 2022-03-21T13:54:30.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.197+0000 7f5004ff9700 1 -- 172.21.15.160:0/4041165080 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4ffc0524c0 con 0x7f50080c7400 2022-03-21T13:54:30.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 -- 172.21.15.160:0/4041165080 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4fe8063ce0 msgr2=0x7f4fe8066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:30.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4fe8063ce0 0x7f4fe8066190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80047d0 tx=0x7f4ff8007bb0 comp rx=0 tx=0).stop 2022-03-21T13:54:30.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 -- 172.21.15.160:0/4041165080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50080c7400 msgr2=0x7f50080c1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:30.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50080c7400 0x7f50080c1960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c440 tx=0x7f4ffc007de0 comp rx=0 tx=0).stop 2022-03-21T13:54:30.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 -- 172.21.15.160:0/4041165080 shutdown_connections 2022-03-21T13:54:30.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4fe8063ce0 0x7f4fe8066190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:30.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5008158350 0x7f500815b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:30.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f500806ae30 0x7f50081590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:30.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 --2- 172.21.15.160:0/4041165080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50080c7400 0x7f50080c1960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:30.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 -- 172.21.15.160:0/4041165080 >> 172.21.15.160:0/4041165080 conn(0x7f50080cb000 msgr2=0x7f5008153f60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:30.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 -- 172.21.15.160:0/4041165080 shutdown_connections 2022-03-21T13:54:30.204 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.199+0000 7f500ef61700 1 -- 172.21.15.160:0/4041165080 wait complete. 2022-03-21T13:54:30.214 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2022-03-21T13:54:30.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.332+0000 7f72dbd99700 1 Processor -- start 2022-03-21T13:54:30.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.332+0000 7f72dbd99700 1 -- start start 2022-03-21T13:54:30.337 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72dbd99700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f72d406d480 0x7f72d40c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:30.337 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72dbd99700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72d40c3c50 0x7f72d40c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:30.337 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72dbd99700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d4067cb0 con 0x7f72d40c48c0 2022-03-21T13:54:30.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72dbd99700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d4066dc0 con 0x7f72d406d480 2022-03-21T13:54:30.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72dbd99700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40670a0 con 0x7f72d40c3c50 2022-03-21T13:54:30.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72d9b35700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f72d406d480 0x7f72d40c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:30.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72da336700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f72d40c48c0 0x7f72d406c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59464/0 (socket says 172.21.15.160:59464) 2022-03-21T13:54:30.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72da336700 1 -- 172.21.15.160:0/3780797862 learned_addr learned my addr 172.21.15.160:0/3780797862 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:30.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72d9334700 1 --2- 172.21.15.160:0/3780797862 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72d40c3c50 0x7f72d40c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:30.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72d9b35700 1 -- 172.21.15.160:0/3780797862 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72d40c3c50 msgr2=0x7f72d40c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:30.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72d9b35700 1 --2- 172.21.15.160:0/3780797862 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72d40c3c50 0x7f72d40c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:30.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72d9b35700 1 -- 172.21.15.160:0/3780797862 >> v1:172.21.15.160:6789/0 conn(0x7f72d40c48c0 legacy=0x7f72d406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:30.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72d9b35700 1 -- 172.21.15.160:0/3780797862 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4067380 con 0x7f72d406d480 2022-03-21T13:54:30.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.333+0000 7f72d8b33700 1 -- 172.21.15.160:0/3780797862 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791235201 0 0) 0x7f72d4067cb0 con 0x7f72d40c48c0 2022-03-21T13:54:30.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72d9b35700 1 --2- 172.21.15.160:0/3780797862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72d406d480 0x7f72d40c3710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009e60 tx=0x7f72c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e265f32a9ceac426 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:30.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72d8b33700 1 -- 172.21.15.160:0/3780797862 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400e070 con 0x7f72d406d480 2022-03-21T13:54:30.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72d8b33700 1 -- 172.21.15.160:0/3780797862 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c400bc30 con 0x7f72d406d480 2022-03-21T13:54:30.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72d8b33700 1 -- 172.21.15.160:0/3780797862 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4012430 con 0x7f72d406d480 2022-03-21T13:54:30.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72dbd99700 1 -- 172.21.15.160:0/3780797862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72d406d480 msgr2=0x7f72d40c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:30.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72dbd99700 1 --2- 172.21.15.160:0/3780797862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72d406d480 0x7f72d40c3710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009e60 tx=0x7f72c4009780 comp rx=0 tx=0).stop 2022-03-21T13:54:30.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72dbd99700 1 -- 172.21.15.160:0/3780797862 shutdown_connections 2022-03-21T13:54:30.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72dbd99700 1 --2- 172.21.15.160:0/3780797862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72d406d480 0x7f72d40c3710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:30.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72dbd99700 1 --2- 172.21.15.160:0/3780797862 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72d40c3c50 0x7f72d40c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:30.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72dbd99700 1 -- 172.21.15.160:0/3780797862 >> 172.21.15.160:0/3780797862 conn(0x7f72d40c9910 msgr2=0x7f72d40c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:30.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72dbd99700 1 -- 172.21.15.160:0/3780797862 shutdown_connections 2022-03-21T13:54:30.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.334+0000 7f72dbd99700 1 -- 172.21.15.160:0/3780797862 wait complete. 2022-03-21T13:54:30.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.335+0000 7f72dbd99700 1 Processor -- start 2022-03-21T13:54:30.343 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.335+0000 7f72dbd99700 1 -- start start 2022-03-21T13:54:30.345 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72dbd99700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72d406d480 0x7f72d4168260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:30.345 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72dbd99700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72d40c3c50 0x7f72d40aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:30.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72dbd99700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72d40c48c0 0x7f72d40ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:30.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72dbd99700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40ae330 con 0x7f72d40c3c50 2022-03-21T13:54:30.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72dbd99700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40bc680 con 0x7f72d406d480 2022-03-21T13:54:30.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72dbd99700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4168f80 con 0x7f72d40c48c0 2022-03-21T13:54:30.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72d9334700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72d40c3c50 0x7f72d40aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:30.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72d9334700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72d40c3c50 0x7f72d40aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56314/0 (socket says 172.21.15.160:56314) 2022-03-21T13:54:30.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72d9334700 1 -- 172.21.15.160:0/1910053366 learned_addr learned my addr 172.21.15.160:0/1910053366 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:30.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72d9334700 1 -- 172.21.15.160:0/1910053366 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72d40c48c0 msgr2=0x7f72d40ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:30.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72d9334700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72d40c48c0 0x7f72d40ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:30.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72d9334700 1 -- 172.21.15.160:0/1910053366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72d406d480 msgr2=0x7f72d4168260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:30.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72d9334700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72d406d480 0x7f72d4168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:30.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72d9334700 1 -- 172.21.15.160:0/1910053366 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c4009a20 con 0x7f72d40c3c50 2022-03-21T13:54:30.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.336+0000 7f72d9334700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72d40c3c50 0x7f72d40aab00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f72c800c880 tx=0x7f72c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:30.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.337+0000 7f72d1ffb700 1 -- 172.21.15.160:0/1910053366 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c8011600 con 0x7f72d40c3c50 2022-03-21T13:54:30.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.337+0000 7f72d1ffb700 1 -- 172.21.15.160:0/1910053366 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c8011760 con 0x7f72d40c3c50 2022-03-21T13:54:30.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.337+0000 7f72dbd99700 1 -- 172.21.15.160:0/1910053366 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d40aa670 con 0x7f72d40c3c50 2022-03-21T13:54:30.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.337+0000 7f72d1ffb700 1 -- 172.21.15.160:0/1910053366 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c8011ae0 con 0x7f72d40c3c50 2022-03-21T13:54:30.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.337+0000 7f72dbd99700 1 -- 172.21.15.160:0/1910053366 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d40c1bd0 con 0x7f72d40c3c50 2022-03-21T13:54:30.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.338+0000 7f72dbd99700 1 -- 172.21.15.160:0/1910053366 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d406fc00 con 0x7f72d40c3c50 2022-03-21T13:54:30.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.338+0000 7f72d1ffb700 1 -- 172.21.15.160:0/1910053366 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f72c8017030 con 0x7f72d40c3c50 2022-03-21T13:54:30.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.338+0000 7f72d1ffb700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f72b4063d10 0x7f72b40661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:30.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.338+0000 7f72d1ffb700 1 -- 172.21.15.160:0/1910053366 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f72c8080290 con 0x7f72d40c3c50 2022-03-21T13:54:30.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.338+0000 7f72d9b35700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f72b4063d10 0x7f72b40661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:30.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.339+0000 7f72d9b35700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f72b4063d10 0x7f72b40661c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009e60 tx=0x7f72c4019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:30.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.343+0000 7f72d1ffb700 1 -- 172.21.15.160:0/1910053366 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f72c804ee70 con 0x7f72d40c3c50 2022-03-21T13:54:30.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:30.553+0000 7f72dbd99700 1 -- 172.21.15.160:0/1910053366 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f72d40c4160 con 0x7f72d40c3c50 2022-03-21T13:54:31.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.198+0000 7f72d1ffb700 1 -- 172.21.15.160:0/1910053366 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72c801f020 con 0x7f72d40c3c50 2022-03-21T13:54:31.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 -- 172.21.15.160:0/1910053366 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f72b4063d10 msgr2=0x7f72b40661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:31.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f72b4063d10 0x7f72b40661c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009e60 tx=0x7f72c4019000 comp rx=0 tx=0).stop 2022-03-21T13:54:31.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 -- 172.21.15.160:0/1910053366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72d40c3c50 msgr2=0x7f72d40aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:31.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72d40c3c50 0x7f72d40aab00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f72c800c880 tx=0x7f72c8008040 comp rx=0 tx=0).stop 2022-03-21T13:54:31.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 -- 172.21.15.160:0/1910053366 shutdown_connections 2022-03-21T13:54:31.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f72b4063d10 0x7f72b40661c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:31.204 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72d40c48c0 0x7f72d40ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:31.204 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72d406d480 0x7f72d4168260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:31.204 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 --2- 172.21.15.160:0/1910053366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72d40c3c50 0x7f72d40aab00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:31.204 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 -- 172.21.15.160:0/1910053366 >> 172.21.15.160:0/1910053366 conn(0x7f72d40c9910 msgr2=0x7f72d41551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:31.205 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 -- 172.21.15.160:0/1910053366 shutdown_connections 2022-03-21T13:54:31.205 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.200+0000 7f72dbd99700 1 -- 172.21.15.160:0/1910053366 wait complete. 2022-03-21T13:54:31.215 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2022-03-21T13:54:31.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.332+0000 7f437bb6a700 1 Processor -- start 2022-03-21T13:54:31.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.332+0000 7f437bb6a700 1 -- start start 2022-03-21T13:54:31.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.333+0000 7f437bb6a700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f437406d760 0x7f437406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:31.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.333+0000 7f437bb6a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437406c5b0 0x7f4374155220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:31.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.333+0000 7f437bb6a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437406b5a0 con 0x7f43740c6210 2022-03-21T13:54:31.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.333+0000 7f437bb6a700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437406db30 con 0x7f437406d760 2022-03-21T13:54:31.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.333+0000 7f437bb6a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437406ca30 con 0x7f437406c5b0 2022-03-21T13:54:31.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.333+0000 7f4379105700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f43740c6210 0x7f4374154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59476/0 (socket says 172.21.15.160:59476) 2022-03-21T13:54:31.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.333+0000 7f4379105700 1 -- 172.21.15.160:0/3581306287 learned_addr learned my addr 172.21.15.160:0/3581306287 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:31.343 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.333+0000 7f4379906700 1 --2- 172.21.15.160:0/3581306287 >> v2:172.21.15.171:3300/0 conn(0x7f437406d760 0x7f437406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:31.343 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.333+0000 7f437a107700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437406c5b0 0x7f4374155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:31.343 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.333+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854781702 0 0) 0x7f437406b5a0 con 0x7f43740c6210 2022-03-21T13:54:31.343 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.333+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43600033f0 con 0x7f43740c6210 2022-03-21T13:54:31.343 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1792377045 0 0) 0x7f43600033f0 con 0x7f43740c6210 2022-03-21T13:54:31.344 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437406c5b0 msgr2=0x7f4374155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:31.344 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437406c5b0 0x7f4374155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:31.344 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 >> v2:172.21.15.171:3300/0 conn(0x7f437406d760 msgr2=0x7f437406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:31.344 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 --2- 172.21.15.160:0/3581306287 >> v2:172.21.15.171:3300/0 conn(0x7f437406d760 0x7f437406c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:31.345 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437406a9e0 con 0x7f43740c6210 2022-03-21T13:54:31.345 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7f4368001470 con 0x7f43740c6210 2022-03-21T13:54:31.345 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4379906700 1 --2- 172.21.15.160:0/3581306287 >> v2:172.21.15.171:3300/0 conn(0x7f437406d760 0x7f437406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:31.345 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 >> v1:172.21.15.160:6789/0 conn(0x7f43740c6210 legacy=0x7f4374154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:31.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437406c5b0 0x7f43600038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:31.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4360003e60 0x7f4360004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:31.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4360004bd0 0x7f4360005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:31.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437406db30 con 0x7f4360004bd0 2022-03-21T13:54:31.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437406ca30 con 0x7f4360003e60 2022-03-21T13:54:31.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436000b910 con 0x7f437406c5b0 2022-03-21T13:54:31.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f437a107700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4360004bd0 0x7f4360005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:31.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4379906700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437406c5b0 0x7f43600038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:31.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4379105700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4360003e60 0x7f4360004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:31.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f437a107700 1 -- 172.21.15.160:0/3581306287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437406c5b0 msgr2=0x7f43600038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:31.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f437a107700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437406c5b0 0x7f43600038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:31.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f437a107700 1 -- 172.21.15.160:0/3581306287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4360003e60 msgr2=0x7f4360004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:31.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f437a107700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4360003e60 0x7f4360004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:31.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f437a107700 1 -- 172.21.15.160:0/3581306287 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43600033f0 con 0x7f4360004bd0 2022-03-21T13:54:31.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f437a107700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4360004bd0 0x7f4360005040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f436c009a80 tx=0x7f436c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb5bee12b3a07a5 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:31.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c009430 con 0x7f4360004bd0 2022-03-21T13:54:31.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c00e5e0 con 0x7f4360004bd0 2022-03-21T13:54:31.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.334+0000 7f4378904700 1 -- 172.21.15.160:0/3581306287 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c00e9a0 con 0x7f4360004bd0 2022-03-21T13:54:31.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.335+0000 7f437bb6a700 1 -- 172.21.15.160:0/3581306287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4360004bd0 msgr2=0x7f4360005040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:31.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.335+0000 7f437bb6a700 1 --2- 172.21.15.160:0/3581306287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4360004bd0 0x7f4360005040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f436c009a80 tx=0x7f436c009060 comp rx=0 tx=0).stop 2022-03-21T13:54:31.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.335+0000 7f437a107700 1 -- 172.21.15.160:0/3581306287 reap_dead start 2022-03-21T13:54:31.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.335+0000 7f437bb6a700 1 -- 172.21.15.160:0/3581306287 shutdown_connections 2022-03-21T13:54:31.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.335+0000 7f437bb6a700 1 -- 172.21.15.160:0/3581306287 >> 172.21.15.160:0/3581306287 conn(0x7f4374068640 msgr2=0x7f43740cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:31.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.335+0000 7f437bb6a700 1 -- 172.21.15.160:0/3581306287 shutdown_connections 2022-03-21T13:54:31.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.335+0000 7f437bb6a700 1 -- 172.21.15.160:0/3581306287 wait complete. 2022-03-21T13:54:31.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.336+0000 7f437bb6a700 1 Processor -- start 2022-03-21T13:54:31.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.336+0000 7f437bb6a700 1 -- start start 2022-03-21T13:54:31.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437bb6a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4360004bd0 0x7f4374150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:31.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437bb6a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4374156f50 0x7f437414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:31.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437bb6a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43741573a0 0x7f437414df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:31.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437bb6a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4374165d80 con 0x7f43741573a0 2022-03-21T13:54:31.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437bb6a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4374155c70 con 0x7f4374156f50 2022-03-21T13:54:31.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437bb6a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43740c4ef0 con 0x7f4360004bd0 2022-03-21T13:54:31.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437a107700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43741573a0 0x7f437414df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:31.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437a107700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43741573a0 0x7f437414df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56338/0 (socket says 172.21.15.160:56338) 2022-03-21T13:54:31.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437a107700 1 -- 172.21.15.160:0/2816811173 learned_addr learned my addr 172.21.15.160:0/2816811173 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:31.354 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f4379906700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4360004bd0 0x7f4374150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:31.354 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f4379105700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4374156f50 0x7f437414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:31.354 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437a107700 1 -- 172.21.15.160:0/2816811173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4360004bd0 msgr2=0x7f4374150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:31.354 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437a107700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4360004bd0 0x7f4374150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:31.354 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437a107700 1 -- 172.21.15.160:0/2816811173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4374156f50 msgr2=0x7f437414d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:31.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437a107700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4374156f50 0x7f437414d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:31.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437a107700 1 -- 172.21.15.160:0/2816811173 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4374165200 con 0x7f43741573a0 2022-03-21T13:54:31.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f4379906700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4360004bd0 0x7f4374150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:31.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437a107700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43741573a0 0x7f437414df20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f43600045b0 tx=0x7f436c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f4371ffb700 1 -- 172.21.15.160:0/2816811173 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c009430 con 0x7f43741573a0 2022-03-21T13:54:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f4371ffb700 1 -- 172.21.15.160:0/2816811173 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c0036f0 con 0x7f43741573a0 2022-03-21T13:54:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437bb6a700 1 -- 172.21.15.160:0/2816811173 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43741654e0 con 0x7f43741573a0 2022-03-21T13:54:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f4371ffb700 1 -- 172.21.15.160:0/2816811173 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c003ab0 con 0x7f43741573a0 2022-03-21T13:54:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.337+0000 7f437bb6a700 1 -- 172.21.15.160:0/2816811173 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4374165aa0 con 0x7f43741573a0 2022-03-21T13:54:31.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.338+0000 7f437bb6a700 1 -- 172.21.15.160:0/2816811173 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437406fc00 con 0x7f43741573a0 2022-03-21T13:54:31.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.339+0000 7f4371ffb700 1 -- 172.21.15.160:0/2816811173 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f436c019030 con 0x7f43741573a0 2022-03-21T13:54:31.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.339+0000 7f4371ffb700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4354063ce0 0x7f4354066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:31.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.339+0000 7f4371ffb700 1 -- 172.21.15.160:0/2816811173 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f436c081ba0 con 0x7f43741573a0 2022-03-21T13:54:31.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.339+0000 7f4379906700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4354063ce0 0x7f4354066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:31.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.340+0000 7f4379906700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4354063ce0 0x7f4354066190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43640094a0 tx=0x7f436400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:31.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.343+0000 7f4371ffb700 1 -- 172.21.15.160:0/2816811173 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f436c0508a0 con 0x7f43741573a0 2022-03-21T13:54:31.557 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:31.555+0000 7f437bb6a700 1 -- 172.21.15.160:0/2816811173 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f43740c5f30 con 0x7f43741573a0 2022-03-21T13:54:32.207 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.205+0000 7f4371ffb700 1 -- 172.21.15.160:0/2816811173 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) v1 ==== 115+0+0 (secure 0 0 0) 0x7f436c02b020 con 0x7f43741573a0 2022-03-21T13:54:32.209 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 -- 172.21.15.160:0/2816811173 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4354063ce0 msgr2=0x7f4354066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.209 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4354063ce0 0x7f4354066190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43640094a0 tx=0x7f436400b040 comp rx=0 tx=0).stop 2022-03-21T13:54:32.210 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 -- 172.21.15.160:0/2816811173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43741573a0 msgr2=0x7f437414df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.210 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43741573a0 0x7f437414df20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f43600045b0 tx=0x7f436c01a000 comp rx=0 tx=0).stop 2022-03-21T13:54:32.210 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 -- 172.21.15.160:0/2816811173 shutdown_connections 2022-03-21T13:54:32.210 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4354063ce0 0x7f4354066190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.211 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43741573a0 0x7f437414df20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.211 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4360004bd0 0x7f4374150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.211 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 --2- 172.21.15.160:0/2816811173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4374156f50 0x7f437414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.211 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 -- 172.21.15.160:0/2816811173 >> 172.21.15.160:0/2816811173 conn(0x7f4374068640 msgr2=0x7f43740c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:32.212 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 -- 172.21.15.160:0/2816811173 shutdown_connections 2022-03-21T13:54:32.212 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.207+0000 7f437bb6a700 1 -- 172.21.15.160:0/2816811173 wait complete. 2022-03-21T13:54:32.222 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-03-21T13:54:32.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.336+0000 7f1804b85700 1 Processor -- start 2022-03-21T13:54:32.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.336+0000 7f1804b85700 1 -- start start 2022-03-21T13:54:32.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.337+0000 7f1804b85700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180014cc30 0x7f18000c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.337+0000 7f1804b85700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000c0310 con 0x7f180014d000 2022-03-21T13:54:32.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.337+0000 7f1804b85700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000c39a0 con 0x7f18000c4eb0 2022-03-21T13:54:32.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.337+0000 7f1804b85700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000c13c0 con 0x7f180014cc30 2022-03-21T13:54:32.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.337+0000 7f17f7fff700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f180014d000 0x7f18000c47a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59498/0 (socket says 172.21.15.160:59498) 2022-03-21T13:54:32.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.337+0000 7f17f7fff700 1 -- 172.21.15.160:0/112823226 learned_addr learned my addr 172.21.15.160:0/112823226 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:32.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252670700 0 0) 0x7f18000c0310 con 0x7f180014d000 2022-03-21T13:54:32.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fe59c700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180014cc30 0x7f18000c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17e00033f0 con 0x7f180014d000 2022-03-21T13:54:32.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1158454925 0 0) 0x7f17e00033f0 con 0x7f180014d000 2022-03-21T13:54:32.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180014cc30 msgr2=0x7f18000c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:32.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180014cc30 0x7f18000c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 >> v1:172.21.15.171:6789/0 conn(0x7f18000c4eb0 legacy=0x7f1800152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180006de00 con 0x7f180014d000 2022-03-21T13:54:32.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7f17e8001470 con 0x7f180014d000 2022-03-21T13:54:32.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 >> v1:172.21.15.160:6789/0 conn(0x7f180014d000 legacy=0x7f18000c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17e0003910 0x7f17e0003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 0x7f17e0004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180014cc30 0x7f17e0005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000c13c0 con 0x7f17e0004690 2022-03-21T13:54:32.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e000b9e0 con 0x7f17e0003910 2022-03-21T13:54:32.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e000bba0 con 0x7f180014cc30 2022-03-21T13:54:32.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17f7fff700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 0x7f17e0004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fe59c700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17e0003910 0x7f17e0003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17fed9d700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180014cc30 0x7f17e0005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17f7fff700 1 -- 172.21.15.160:0/112823226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180014cc30 msgr2=0x7f17e0005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:32.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17f7fff700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180014cc30 0x7f17e0005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17f7fff700 1 -- 172.21.15.160:0/112823226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17e0003910 msgr2=0x7f17e0003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:32.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17f7fff700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17e0003910 0x7f17e0003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17f7fff700 1 -- 172.21.15.160:0/112823226 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e00033f0 con 0x7f17e0004690 2022-03-21T13:54:32.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.338+0000 7f17f7fff700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 0x7f17e0004b00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17e800c160 tx=0x7f17e8001e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1698b38e2c062b86 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:32.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.339+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e800ca90 con 0x7f17e0004690 2022-03-21T13:54:32.352 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.339+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e800cbf0 con 0x7f17e0004690 2022-03-21T13:54:32.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.339+0000 7f17fdd9b700 1 -- 172.21.15.160:0/112823226 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80070d0 con 0x7f17e0004690 2022-03-21T13:54:32.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.339+0000 7f1804b85700 1 -- 172.21.15.160:0/112823226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 msgr2=0x7f17e0004b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.353 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.339+0000 7f1804b85700 1 --2- 172.21.15.160:0/112823226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 0x7f17e0004b00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17e800c160 tx=0x7f17e8001e30 comp rx=0 tx=0).stop 2022-03-21T13:54:32.354 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.339+0000 7f17fed9d700 1 -- 172.21.15.160:0/112823226 reap_dead start 2022-03-21T13:54:32.354 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.339+0000 7f1804b85700 1 -- 172.21.15.160:0/112823226 shutdown_connections 2022-03-21T13:54:32.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.339+0000 7f1804b85700 1 -- 172.21.15.160:0/112823226 >> 172.21.15.160:0/112823226 conn(0x7f18000c98f0 msgr2=0x7f18000c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:32.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.339+0000 7f1804b85700 1 -- 172.21.15.160:0/112823226 shutdown_connections 2022-03-21T13:54:32.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.339+0000 7f1804b85700 1 -- 172.21.15.160:0/112823226 wait complete. 2022-03-21T13:54:32.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.340+0000 7f1804b85700 1 Processor -- start 2022-03-21T13:54:32.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.340+0000 7f1804b85700 1 -- start start 2022-03-21T13:54:32.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f1804b85700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 0x7f1800163030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f1804b85700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1800149fa0 0x7f18000bea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f1804b85700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180014fef0 0x7f1800150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f1804b85700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180014a620 con 0x7f17e0004690 2022-03-21T13:54:32.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f1804b85700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180014fa60 con 0x7f180014fef0 2022-03-21T13:54:32.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f1804b85700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1800163570 con 0x7f1800149fa0 2022-03-21T13:54:32.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17fe59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 0x7f1800163030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17fe59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 0x7f1800163030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56354/0 (socket says 172.21.15.160:56354) 2022-03-21T13:54:32.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17fe59c700 1 -- 172.21.15.160:0/1120132650 learned_addr learned my addr 172.21.15.160:0/1120132650 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:32.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17f7fff700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1800149fa0 0x7f18000bea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17fed9d700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180014fef0 0x7f1800150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17fe59c700 1 -- 172.21.15.160:0/1120132650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1800149fa0 msgr2=0x7f18000bea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17fe59c700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1800149fa0 0x7f18000bea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17fe59c700 1 -- 172.21.15.160:0/1120132650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180014fef0 msgr2=0x7f1800150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.359 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17fe59c700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180014fef0 0x7f1800150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.359 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17fe59c700 1 -- 172.21.15.160:0/1120132650 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18001508a0 con 0x7f17e0004690 2022-03-21T13:54:32.359 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17f7fff700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1800149fa0 0x7f18000bea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:32.359 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17fe59c700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 0x7f1800163030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17f0011a20 tx=0x7f17f0009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:32.359 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17f67fc700 1 -- 172.21.15.160:0/1120132650 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0004240 con 0x7f17e0004690 2022-03-21T13:54:32.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17f67fc700 1 -- 172.21.15.160:0/1120132650 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f00043a0 con 0x7f17e0004690 2022-03-21T13:54:32.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.341+0000 7f17f67fc700 1 -- 172.21.15.160:0/1120132650 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f000f900 con 0x7f17e0004690 2022-03-21T13:54:32.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.342+0000 7f1804b85700 1 -- 172.21.15.160:0/1120132650 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1800154020 con 0x7f17e0004690 2022-03-21T13:54:32.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.342+0000 7f1804b85700 1 -- 172.21.15.160:0/1120132650 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18001545e0 con 0x7f17e0004690 2022-03-21T13:54:32.360 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.342+0000 7f1804b85700 1 -- 172.21.15.160:0/1120132650 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180006fc00 con 0x7f17e0004690 2022-03-21T13:54:32.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.343+0000 7f17f67fc700 1 -- 172.21.15.160:0/1120132650 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f17f0024070 con 0x7f17e0004690 2022-03-21T13:54:32.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.343+0000 7f17f67fc700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f17e4063ce0 0x7f17e4066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.343+0000 7f17f67fc700 1 -- 172.21.15.160:0/1120132650 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f17f0018030 con 0x7f17e0004690 2022-03-21T13:54:32.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.343+0000 7f17f7fff700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f17e4063ce0 0x7f17e4066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.361 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.343+0000 7f17f7fff700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f17e4063ce0 0x7f17e4066190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f18000aeb40 tx=0x7f17e8015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:32.362 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.347+0000 7f17f67fc700 1 -- 172.21.15.160:0/1120132650 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f17f004fbc0 con 0x7f17e0004690 2022-03-21T13:54:32.561 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.560+0000 7f1804b85700 1 -- 172.21.15.160:0/1120132650 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18000c0560 con 0x7f17e0004690 2022-03-21T13:54:32.562 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.560+0000 7f17f67fc700 1 -- 172.21.15.160:0/1120132650 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6118 (secure 0 0 0) 0x7f17f0022030 con 0x7f17e0004690 2022-03-21T13:54:32.562 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:32.563 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1715710880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1715710880},{"type":"v1","addr":"172.21.15.160:6835","nonce":1715710880}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/307954587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":307954587},{"type":"v1","addr":"172.21.15.171:6833","nonce":307954587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3534006535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3534006535},{"type":"v1","addr":"172.21.15.160:6837","nonce":3534006535}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/826342148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":826342148},{"type":"v1","addr":"172.21.15.171:6835","nonce":826342148}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/4108285334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":4108285334},{"type":"v1","addr":"172.21.15.160:6839","nonce":4108285334}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-03-21T13:54:27.533757+0000","modified":"2022-03-21T13:54:32.201388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.171:6837/4225939003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4225939003},{"type":"v1","addr":"172.21.15.171:6837","nonce":4225939003}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-03-21T13:54:32.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.562+0000 7f1804b85700 1 -- 172.21.15.160:0/1120132650 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f17e4063ce0 msgr2=0x7f17e4066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.562+0000 7f1804b85700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f17e4063ce0 0x7f17e4066190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f18000aeb40 tx=0x7f17e8015000 comp rx=0 tx=0).stop 2022-03-21T13:54:32.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.562+0000 7f1804b85700 1 -- 172.21.15.160:0/1120132650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 msgr2=0x7f1800163030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.562+0000 7f1804b85700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 0x7f1800163030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17f0011a20 tx=0x7f17f0009060 comp rx=0 tx=0).stop 2022-03-21T13:54:32.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.562+0000 7f1804b85700 1 -- 172.21.15.160:0/1120132650 shutdown_connections 2022-03-21T13:54:32.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.562+0000 7f1804b85700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f17e4063ce0 0x7f17e4066190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.562+0000 7f1804b85700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180014fef0 0x7f1800150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.562+0000 7f1804b85700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e0004690 0x7f1800163030 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.562+0000 7f1804b85700 1 --2- 172.21.15.160:0/1120132650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1800149fa0 0x7f18000bea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.567 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.562+0000 7f1804b85700 1 -- 172.21.15.160:0/1120132650 >> 172.21.15.160:0/1120132650 conn(0x7f18000c98f0 msgr2=0x7f18000c6240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:32.567 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.563+0000 7f1804b85700 1 -- 172.21.15.160:0/1120132650 shutdown_connections 2022-03-21T13:54:32.567 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.563+0000 7f1804b85700 1 -- 172.21.15.160:0/1120132650 wait complete. 2022-03-21T13:54:32.568 INFO:teuthology.orchestra.run.smithi160.stderr:dumped fsmap epoch 8 2022-03-21T13:54:32.576 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-21T13:54:32.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.688+0000 7f051789d700 1 Processor -- start 2022-03-21T13:54:32.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.688+0000 7f051789d700 1 -- start start 2022-03-21T13:54:32.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.688+0000 7f051789d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f05100c45d0 0x7f05100c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.688+0000 7f051789d700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f051006ac50 0x7f05100c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f051789d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f051006b6d0 con 0x7f05100c49a0 2022-03-21T13:54:32.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f051789d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05100c7300 con 0x7f05100c45d0 2022-03-21T13:54:32.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f051789d700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051006a6d0 con 0x7f051006ac50 2022-03-21T13:54:32.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f0515639700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f05100c45d0 0x7f05100c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f0515e3a700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f05100c49a0 0x7f05100c33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59516/0 (socket says 172.21.15.160:59516) 2022-03-21T13:54:32.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f0515639700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f05100c45d0 0x7f05100c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56362/0 (socket says 172.21.15.160:56362) 2022-03-21T13:54:32.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f0515e3a700 1 -- 172.21.15.160:0/1508808326 learned_addr learned my addr 172.21.15.160:0/1508808326 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:32.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f0514e38700 1 --2- 172.21.15.160:0/1508808326 >> v2:172.21.15.171:3300/0 conn(0x7f051006ac50 0x7f05100c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f0515639700 1 -- 172.21.15.160:0/1508808326 >> v2:172.21.15.171:3300/0 conn(0x7f051006ac50 msgr2=0x7f05100c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:32.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f0515639700 1 --2- 172.21.15.160:0/1508808326 >> v2:172.21.15.171:3300/0 conn(0x7f051006ac50 0x7f05100c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f0515639700 1 -- 172.21.15.160:0/1508808326 >> v1:172.21.15.160:6789/0 conn(0x7f05100c49a0 legacy=0x7f05100c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f0515639700 1 -- 172.21.15.160:0/1508808326 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051006b900 con 0x7f05100c45d0 2022-03-21T13:54:32.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f050ffff700 1 -- 172.21.15.160:0/1508808326 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153338637 0 0) 0x7f051006b6d0 con 0x7f05100c49a0 2022-03-21T13:54:32.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f0515639700 1 --2- 172.21.15.160:0/1508808326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05100c45d0 0x7f05100c58b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0510069fc0 tx=0x7f0500009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bfb55bfb3b441c server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:32.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f050ffff700 1 -- 172.21.15.160:0/1508808326 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000e070 con 0x7f05100c45d0 2022-03-21T13:54:32.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f050ffff700 1 -- 172.21.15.160:0/1508808326 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050000bc30 con 0x7f05100c45d0 2022-03-21T13:54:32.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.689+0000 7f050ffff700 1 -- 172.21.15.160:0/1508808326 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500012430 con 0x7f05100c45d0 2022-03-21T13:54:32.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.690+0000 7f051789d700 1 -- 172.21.15.160:0/1508808326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05100c45d0 msgr2=0x7f05100c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.690+0000 7f051789d700 1 --2- 172.21.15.160:0/1508808326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05100c45d0 0x7f05100c58b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0510069fc0 tx=0x7f0500009780 comp rx=0 tx=0).stop 2022-03-21T13:54:32.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.690+0000 7f051789d700 1 -- 172.21.15.160:0/1508808326 shutdown_connections 2022-03-21T13:54:32.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.690+0000 7f051789d700 1 --2- 172.21.15.160:0/1508808326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05100c45d0 0x7f05100c58b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.690+0000 7f051789d700 1 --2- 172.21.15.160:0/1508808326 >> v2:172.21.15.171:3300/0 conn(0x7f051006ac50 0x7f05100c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.690+0000 7f051789d700 1 -- 172.21.15.160:0/1508808326 >> 172.21.15.160:0/1508808326 conn(0x7f0510068650 msgr2=0x7f05100cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:32.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.690+0000 7f051789d700 1 -- 172.21.15.160:0/1508808326 shutdown_connections 2022-03-21T13:54:32.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.690+0000 7f051789d700 1 -- 172.21.15.160:0/1508808326 wait complete. 2022-03-21T13:54:32.700 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.691+0000 7f051789d700 1 Processor -- start 2022-03-21T13:54:32.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.691+0000 7f051789d700 1 -- start start 2022-03-21T13:54:32.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f051789d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05100c45d0 0x7f05100a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f051789d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05100c49a0 0x7f05100ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.701 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f051789d700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0510159de0 0x7f0510155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f051789d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0510168820 con 0x7f05100c45d0 2022-03-21T13:54:32.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f051789d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05100aa920 con 0x7f05100c49a0 2022-03-21T13:54:32.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f051789d700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0510168c40 con 0x7f0510159de0 2022-03-21T13:54:32.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f0515639700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05100c45d0 0x7f05100a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.702 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f0515639700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05100c45d0 0x7f05100a9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56368/0 (socket says 172.21.15.160:56368) 2022-03-21T13:54:32.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f0515639700 1 -- 172.21.15.160:0/1640992755 learned_addr learned my addr 172.21.15.160:0/1640992755 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:32.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f0515639700 1 -- 172.21.15.160:0/1640992755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0510159de0 msgr2=0x7f0510155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f0514e38700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05100c49a0 0x7f05100ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f0515639700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0510159de0 0x7f0510155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.703 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f0515639700 1 -- 172.21.15.160:0/1640992755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05100c49a0 msgr2=0x7f05100ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f0515639700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05100c49a0 0x7f05100ab4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f0515639700 1 -- 172.21.15.160:0/1640992755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500009a20 con 0x7f05100c45d0 2022-03-21T13:54:32.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f0515639700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05100c45d0 0x7f05100a9fb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0510064460 tx=0x7f0500019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:32.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f050d7fa700 1 -- 172.21.15.160:0/1640992755 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500003e50 con 0x7f05100c45d0 2022-03-21T13:54:32.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f050d7fa700 1 -- 172.21.15.160:0/1640992755 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0500012810 con 0x7f05100c45d0 2022-03-21T13:54:32.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f051789d700 1 -- 172.21.15.160:0/1640992755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05100ad670 con 0x7f05100c45d0 2022-03-21T13:54:32.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f050d7fa700 1 -- 172.21.15.160:0/1640992755 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500012bd0 con 0x7f05100c45d0 2022-03-21T13:54:32.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.692+0000 7f051789d700 1 -- 172.21.15.160:0/1640992755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0510167e80 con 0x7f05100c45d0 2022-03-21T13:54:32.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.693+0000 7f051789d700 1 -- 172.21.15.160:0/1640992755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051006fc00 con 0x7f05100c45d0 2022-03-21T13:54:32.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.694+0000 7f050d7fa700 1 -- 172.21.15.160:0/1640992755 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f0500004040 con 0x7f05100c45d0 2022-03-21T13:54:32.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.694+0000 7f050d7fa700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f04f0063ce0 0x7f04f0066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:32.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.694+0000 7f0514e38700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f04f0063ce0 0x7f04f0066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:32.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.694+0000 7f050d7fa700 1 -- 172.21.15.160:0/1640992755 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0500083090 con 0x7f05100c45d0 2022-03-21T13:54:32.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.695+0000 7f0514e38700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f04f0063ce0 0x7f04f0066190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0504006fd0 tx=0x7f0504008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:32.707 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.698+0000 7f050d7fa700 1 -- 172.21.15.160:0/1640992755 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f0500051c70 con 0x7f05100c45d0 2022-03-21T13:54:32.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.870+0000 7f051789d700 1 -- 172.21.15.160:0/1640992755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f051006bbe0 con 0x7f05100c45d0 2022-03-21T13:54:32.873 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.871+0000 7f050d7fa700 1 -- 172.21.15.160:0/1640992755 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16893 (secure 0 0 0) 0x7f050002c070 con 0x7f05100c45d0 2022-03-21T13:54:32.873 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:32.873 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":20,"fsid":"b2a3ddc8-064e-4cc9-8187-33ea19afd50a","created":"2022-03-21T13:54:10.384226+0000","modified":"2022-03-21T13:54:28.535055+0000","last_up_change":"2022-03-21T13:54:20.412036+0000","last_in_change":"2022-03-21T13:54:12.760084+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-03-21T13:54:21.458770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-03-21T13:54:21.499620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-21T13:54:25.482900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-21T13:54:26.501704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"828ac39d-86ad-44a1-bb66-c99786642970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":25441},{"type":"v1","addr":"172.21.15.160:6810","nonce":25441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":25441},{"type":"v1","addr":"172.21.15.160:6814","nonce":25441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":25441},{"type":"v1","addr":"172.21.15.160:6822","nonce":25441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":25441},{"type":"v1","addr":"172.21.15.160:6818","nonce":25441}]},"public_addr":"172.21.15.160:6810/25441","cluster_addr":"172.21.15.160:6814/25441","heartbeat_back_addr":"172.21.15.160:6822/25441","heartbeat_front_addr":"172.21.15.160:6818/25441","state":["exists","up"]},{"osd":1,"uuid":"464764e2-a47e-43c0-8c93-b6bfd10ba526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":25442},{"type":"v1","addr":"172.21.15.160:6825","nonce":25442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":25442},{"type":"v1","addr":"172.21.15.160:6827","nonce":25442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":25442},{"type":"v1","addr":"172.21.15.160:6831","nonce":25442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":25442},{"type":"v1","addr":"172.21.15.160:6829","nonce":25442}]},"public_addr":"172.21.15.160:6825/25442","cluster_addr":"172.21.15.160:6827/25442","heartbeat_back_addr":"172.21.15.160:6831/25442","heartbeat_front_addr":"172.21.15.160:6829/25442","state":["exists","up"]},{"osd":2,"uuid":"4dbfea57-14b6-4c67-8312-fc7d71ef77a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":25443},{"type":"v1","addr":"172.21.15.160:6811","nonce":25443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6813","nonce":25443},{"type":"v1","addr":"172.21.15.160:6815","nonce":25443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":25443},{"type":"v1","addr":"172.21.15.160:6823","nonce":25443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":25443},{"type":"v1","addr":"172.21.15.160:6819","nonce":25443}]},"public_addr":"172.21.15.160:6811/25443","cluster_addr":"172.21.15.160:6815/25443","heartbeat_back_addr":"172.21.15.160:6823/25443","heartbeat_front_addr":"172.21.15.160:6819/25443","state":["exists","up"]},{"osd":3,"uuid":"c53ed58d-a1f3-4783-8677-9348a1d103f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":25440},{"type":"v1","addr":"172.21.15.160:6801","nonce":25440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":25440},{"type":"v1","addr":"172.21.15.160:6803","nonce":25440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":25440},{"type":"v1","addr":"172.21.15.160:6807","nonce":25440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":25440},{"type":"v1","addr":"172.21.15.160:6805","nonce":25440}]},"public_addr":"172.21.15.160:6801/25440","cluster_addr":"172.21.15.160:6803/25440","heartbeat_back_addr":"172.21.15.160:6807/25440","heartbeat_front_addr":"172.21.15.160:6805/25440","state":["exists","up"]},{"osd":4,"uuid":"5713dbd4-1736-4ebf-8102-e80f4db6bcc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":25559},{"type":"v1","addr":"172.21.15.171:6817","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":25559},{"type":"v1","addr":"172.21.15.171:6819","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":25559},{"type":"v1","addr":"172.21.15.171:6826","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":25559},{"type":"v1","addr":"172.21.15.171:6821","nonce":25559}]},"public_addr":"172.21.15.171:6817/25559","cluster_addr":"172.21.15.171:6819/25559","heartbeat_back_addr":"172.21.15.171:6826/25559","heartbeat_front_addr":"172.21.15.171:6821/25559","state":["exists","up"]},{"osd":5,"uuid":"dfe21128-6ae6-4662-9f47-1bbb423a2232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":25549},{"type":"v1","addr":"172.21.15.171:6801","nonce":25549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":25549},{"type":"v1","addr":"172.21.15.171:6803","nonce":25549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":25549},{"type":"v1","addr":"172.21.15.171:6807","nonce":25549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":25549},{"type":"v1","addr":"172.21.15.171:6805","nonce":25549}]},"public_addr":"172.21.15.171:6801/25549","cluster_addr":"172.21.15.171:6803/25549","heartbeat_back_addr":"172.21.15.171:6807/25549","heartbeat_front_addr":"172.21.15.171:6805/25549","state":["exists","up"]},{"osd":6,"uuid":"24a9b956-5fa1-41bf-a689-0f048b7f19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":25574},{"type":"v1","addr":"172.21.15.171:6823","nonce":25574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":25574},{"type":"v1","addr":"172.21.15.171:6827","nonce":25574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":25574},{"type":"v1","addr":"172.21.15.171:6831","nonce":25574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":25574},{"type":"v1","addr":"172.21.15.171:6829","nonce":25574}]},"public_addr":"172.21.15.171:6823/25574","cluster_addr":"172.21.15.171:6827/25574","heartbeat_back_addr":"172.21.15.171:6831/25574","heartbeat_front_addr":"172.21.15.171:6829/25574","state":["exists","up"]},{"osd":7,"uuid":"a5ab4a14-8a7b-43b8-932c-a950f81c10f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":25550},{"type":"v1","addr":"172.21.15.171:6809","nonce":25550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":25550},{"type":"v1","addr":"172.21.15.171:6811","nonce":25550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":25550},{"type":"v1","addr":"172.21.15.171:6815","nonce":25550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":25550},{"type":"v1","addr":"172.21.15.171:6813","nonce":25550}]},"public_addr":"172.21.15.171:6809/25550","cluster_addr":"172.21.15.171:6811/25550","heartbeat_back_addr":"172.21.15.171:6815/25550","heartbeat_front_addr":"172.21.15.171:6813/25550","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.888796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.906098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.896027+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.876694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954695+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.846031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.883631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-21T13:54:32.875 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 -- 172.21.15.160:0/1640992755 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f04f0063ce0 msgr2=0x7f04f0066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.875 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f04f0063ce0 0x7f04f0066190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0504006fd0 tx=0x7f0504008040 comp rx=0 tx=0).stop 2022-03-21T13:54:32.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 -- 172.21.15.160:0/1640992755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05100c45d0 msgr2=0x7f05100a9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:32.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05100c45d0 0x7f05100a9fb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0510064460 tx=0x7f0500019000 comp rx=0 tx=0).stop 2022-03-21T13:54:32.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 -- 172.21.15.160:0/1640992755 shutdown_connections 2022-03-21T13:54:32.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f04f0063ce0 0x7f04f0066190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0510159de0 0x7f0510155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05100c45d0 0x7f05100a9fb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 --2- 172.21.15.160:0/1640992755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05100c49a0 0x7f05100ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:32.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 -- 172.21.15.160:0/1640992755 >> 172.21.15.160:0/1640992755 conn(0x7f0510068650 msgr2=0x7f05100c96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:32.878 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 -- 172.21.15.160:0/1640992755 shutdown_connections 2022-03-21T13:54:32.878 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.873+0000 7f051789d700 1 -- 172.21.15.160:0/1640992755 wait complete. 2022-03-21T13:54:32.887 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2022-03-21T13:54:32.888 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-03-21T13:54:33.007 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.998+0000 7f086318b700 1 Processor -- start 2022-03-21T13:54:33.007 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.998+0000 7f086318b700 1 -- start start 2022-03-21T13:54:33.008 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.999+0000 7f086318b700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c14ec50 0x7f085c0c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.008 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.999+0000 7f086318b700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f085c14f020 0x7f085c154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.008 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.999+0000 7f086318b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085c067ab0 con 0x7f085c0c53e0 2022-03-21T13:54:33.008 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.999+0000 7f086318b700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085c0c32c0 con 0x7f085c14f020 2022-03-21T13:54:33.009 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.999+0000 7f086318b700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085c0c3a20 con 0x7f085c14ec50 2022-03-21T13:54:33.009 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.999+0000 7f085bfff700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f085c0c53e0 0x7f085c06c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59530/0 (socket says 172.21.15.160:59530) 2022-03-21T13:54:33.009 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:32.999+0000 7f085bfff700 1 -- 172.21.15.160:0/3519529783 learned_addr learned my addr 172.21.15.160:0/3519529783 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:33.009 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f0860f27700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c14ec50 0x7f085c0c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.010 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f0861728700 1 --2- 172.21.15.160:0/3519529783 >> v2:172.21.15.171:3300/0 conn(0x7f085c14f020 0x7f085c154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.010 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537308589 0 0) 0x7f085c067ab0 con 0x7f085c0c53e0 2022-03-21T13:54:33.010 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f083c0033f0 con 0x7f085c0c53e0 2022-03-21T13:54:33.010 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3835071981 0 0) 0x7f083c0033f0 con 0x7f085c0c53e0 2022-03-21T13:54:33.011 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c14ec50 msgr2=0x7f085c0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:33.011 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c14ec50 0x7f085c0c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.011 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 >> v2:172.21.15.171:3300/0 conn(0x7f085c14f020 msgr2=0x7f085c154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:33.011 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 --2- 172.21.15.160:0/3519529783 >> v2:172.21.15.171:3300/0 conn(0x7f085c14f020 0x7f085c154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.011 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c14f4c0 con 0x7f085c0c53e0 2022-03-21T13:54:33.012 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7f0844001470 con 0x7f085c0c53e0 2022-03-21T13:54:33.012 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 >> v1:172.21.15.160:6789/0 conn(0x7f085c0c53e0 legacy=0x7f085c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.012 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f083c0038e0 0x7f083c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.012 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c14ec50 0x7f083c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.013 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f083c004bd0 0x7f083c005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.013 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c0c32c0 con 0x7f083c004bd0 2022-03-21T13:54:33.013 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c0c3a20 con 0x7f083c0038e0 2022-03-21T13:54:33.013 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c00b8e0 con 0x7f085c14ec50 2022-03-21T13:54:33.013 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f0861728700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f083c004bd0 0x7f083c005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.014 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f0860f27700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f083c0038e0 0x7f083c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.014 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f085bfff700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c14ec50 0x7f083c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.014 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f0861728700 1 -- 172.21.15.160:0/3519529783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c14ec50 msgr2=0x7f083c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:33.014 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f0861728700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c14ec50 0x7f083c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.015 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f0861728700 1 -- 172.21.15.160:0/3519529783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f083c0038e0 msgr2=0x7f083c003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:33.015 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f0861728700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f083c0038e0 0x7f083c003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.015 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f0861728700 1 -- 172.21.15.160:0/3519529783 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c0033f0 con 0x7f083c004bd0 2022-03-21T13:54:33.015 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.000+0000 7f0861728700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f083c004bd0 0x7f083c005040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0854009a80 tx=0x7f0854009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe73f113e1e4c2ec server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:33.015 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.001+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0854009430 con 0x7f083c004bd0 2022-03-21T13:54:33.016 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.001+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085400e5e0 con 0x7f083c004bd0 2022-03-21T13:54:33.016 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.001+0000 7f085b7fe700 1 -- 172.21.15.160:0/3519529783 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085400e9a0 con 0x7f083c004bd0 2022-03-21T13:54:33.016 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.001+0000 7f086318b700 1 -- 172.21.15.160:0/3519529783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f083c004bd0 msgr2=0x7f083c005040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.016 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.001+0000 7f086318b700 1 --2- 172.21.15.160:0/3519529783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f083c004bd0 0x7f083c005040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0854009a80 tx=0x7f0854009060 comp rx=0 tx=0).stop 2022-03-21T13:54:33.017 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.001+0000 7f0861728700 1 -- 172.21.15.160:0/3519529783 reap_dead start 2022-03-21T13:54:33.017 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.001+0000 7f086318b700 1 -- 172.21.15.160:0/3519529783 shutdown_connections 2022-03-21T13:54:33.017 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.001+0000 7f086318b700 1 -- 172.21.15.160:0/3519529783 >> 172.21.15.160:0/3519529783 conn(0x7f085c0c98f0 msgr2=0x7f085c0c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:33.017 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.001+0000 7f086318b700 1 -- 172.21.15.160:0/3519529783 shutdown_connections 2022-03-21T13:54:33.017 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.001+0000 7f086318b700 1 -- 172.21.15.160:0/3519529783 wait complete. 2022-03-21T13:54:33.018 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.002+0000 7f086318b700 1 Processor -- start 2022-03-21T13:54:33.018 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.002+0000 7f086318b700 1 -- start start 2022-03-21T13:54:33.018 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f086318b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f085c0c75f0 0x7f085c166160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.018 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f086318b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f085c153b30 0x7f085c1666a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.019 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f086318b700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c155e30 0x7f085c14dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.019 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f086318b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c165d10 con 0x7f085c153b30 2022-03-21T13:54:33.019 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f086318b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c157100 con 0x7f085c0c75f0 2022-03-21T13:54:33.019 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f086318b700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085c154bf0 con 0x7f085c155e30 2022-03-21T13:54:33.019 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f085bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f085c153b30 0x7f085c1666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.020 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f085bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f085c153b30 0x7f085c1666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56390/0 (socket says 172.21.15.160:56390) 2022-03-21T13:54:33.020 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f085bfff700 1 -- 172.21.15.160:0/841629804 learned_addr learned my addr 172.21.15.160:0/841629804 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:33.020 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f0861728700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c155e30 0x7f085c14dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.020 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f0860f27700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f085c0c75f0 0x7f085c166160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.021 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f085bfff700 1 -- 172.21.15.160:0/841629804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c155e30 msgr2=0x7f085c14dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.021 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f085bfff700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c155e30 0x7f085c14dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.021 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f085bfff700 1 -- 172.21.15.160:0/841629804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f085c0c75f0 msgr2=0x7f085c166160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.021 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f085bfff700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f085c0c75f0 0x7f085c166160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.021 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.003+0000 7f085bfff700 1 -- 172.21.15.160:0/841629804 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c0aed90 con 0x7f085c153b30 2022-03-21T13:54:33.022 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.004+0000 7f085bfff700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f085c153b30 0x7f085c1666a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0844007fd0 tx=0x7f0844001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:33.022 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.004+0000 7f0858ff9700 1 -- 172.21.15.160:0/841629804 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844011590 con 0x7f085c153b30 2022-03-21T13:54:33.022 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.004+0000 7f0858ff9700 1 -- 172.21.15.160:0/841629804 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0844011710 con 0x7f085c153b30 2022-03-21T13:54:33.022 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.004+0000 7f086318b700 1 -- 172.21.15.160:0/841629804 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085c154070 con 0x7f085c153b30 2022-03-21T13:54:33.022 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.004+0000 7f0858ff9700 1 -- 172.21.15.160:0/841629804 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844011ad0 con 0x7f085c153b30 2022-03-21T13:54:33.023 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.004+0000 7f086318b700 1 -- 172.21.15.160:0/841629804 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085c154630 con 0x7f085c153b30 2022-03-21T13:54:33.023 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.005+0000 7f086318b700 1 -- 172.21.15.160:0/841629804 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085c06fc00 con 0x7f085c153b30 2022-03-21T13:54:33.023 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.005+0000 7f0858ff9700 1 -- 172.21.15.160:0/841629804 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f084401d460 con 0x7f085c153b30 2022-03-21T13:54:33.023 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.005+0000 7f0858ff9700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0840063ce0 0x7f0840066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.024 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.005+0000 7f0860f27700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0840063ce0 0x7f0840066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.024 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.005+0000 7f0858ff9700 1 -- 172.21.15.160:0/841629804 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0844080b60 con 0x7f085c153b30 2022-03-21T13:54:33.024 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.006+0000 7f0860f27700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0840063ce0 0x7f0840066190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f084c0094d0 tx=0x7f084c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:33.024 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.009+0000 7f0858ff9700 1 -- 172.21.15.160:0/841629804 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f084404f6e0 con 0x7f085c153b30 2022-03-21T13:54:33.176 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.175+0000 7f086318b700 1 -- 172.21.15.160:0/841629804 --> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f085c0677d0 con 0x7f0840063ce0 2022-03-21T13:54:33.185 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.183+0000 7f0858ff9700 1 -- 172.21.15.160:0/841629804 <== mgr.4104 v2:172.21.15.160:6832/25205 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284940 (secure 0 0 0) 0x7f085c0677d0 con 0x7f0840063ce0 2022-03-21T13:54:33.191 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:33.197 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 -- 172.21.15.160:0/841629804 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0840063ce0 msgr2=0x7f0840066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.197 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0840063ce0 0x7f0840066190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f084c0094d0 tx=0x7f084c00b040 comp rx=0 tx=0).stop 2022-03-21T13:54:33.198 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 -- 172.21.15.160:0/841629804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f085c153b30 msgr2=0x7f085c1666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.198 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f085c153b30 0x7f085c1666a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0844007fd0 tx=0x7f0844001e70 comp rx=0 tx=0).stop 2022-03-21T13:54:33.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 -- 172.21.15.160:0/841629804 shutdown_connections 2022-03-21T13:54:33.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0840063ce0 0x7f0840066190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.200 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f085c155e30 0x7f085c14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.200 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f085c0c75f0 0x7f085c166160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.200 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 --2- 172.21.15.160:0/841629804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f085c153b30 0x7f085c1666a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 -- 172.21.15.160:0/841629804 >> 172.21.15.160:0/841629804 conn(0x7f085c0c98f0 msgr2=0x7f085c066a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:33.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 -- 172.21.15.160:0/841629804 shutdown_connections 2022-03-21T13:54:33.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.186+0000 7f086318b700 1 -- 172.21.15.160:0/841629804 wait complete. 2022-03-21T13:54:33.202 INFO:teuthology.orchestra.run.smithi160.stderr:dumped all 2022-03-21T13:54:33.204 INFO:teuthology.orchestra.run.smithi160.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2022-03-21T13:54:31.458477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68360,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":66624,"kb_avail":754906360,"statfs":{"total":773094113280,"available":773024112640,"internally_reserved":0,"allocated":1712128,"data_stored":1624732,"data_compressed":58760,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":68222976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.299384"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562599+0000","last_change":"2022-03-21T13:54:27.560800+0000","last_active":"2022-03-21T13:54:27.562599+0000","last_peered":"2022-03-21T13:54:27.562599+0000","last_clean":"2022-03-21T13:54:27.562599+0000","last_became_active":"2022-03-21T13:54:27.560524+0000","last_became_peered":"2022-03-21T13:54:27.560524+0000","last_unstale":"2022-03-21T13:54:27.562599+0000","last_undegraded":"2022-03-21T13:54:27.562599+0000","last_fullsized":"2022-03-21T13:54:27.562599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:29:18.469060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.550598+0000","last_change":"2022-03-21T13:54:27.546054+0000","last_active":"2022-03-21T13:54:27.550598+0000","last_peered":"2022-03-21T13:54:27.550598+0000","last_clean":"2022-03-21T13:54:27.550598+0000","last_became_active":"2022-03-21T13:54:27.545740+0000","last_became_peered":"2022-03-21T13:54:27.545740+0000","last_unstale":"2022-03-21T13:54:27.550598+0000","last_undegraded":"2022-03-21T13:54:27.550598+0000","last_fullsized":"2022-03-21T13:54:27.550598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:26:02.461346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561382+0000","last_change":"2022-03-21T13:54:27.558255+0000","last_active":"2022-03-21T13:54:27.561382+0000","last_peered":"2022-03-21T13:54:27.561382+0000","last_clean":"2022-03-21T13:54:27.561382+0000","last_became_active":"2022-03-21T13:54:27.558022+0000","last_became_peered":"2022-03-21T13:54:27.558022+0000","last_unstale":"2022-03-21T13:54:27.561382+0000","last_undegraded":"2022-03-21T13:54:27.561382+0000","last_fullsized":"2022-03-21T13:54:27.561382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:13:18.709698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557489+0000","last_change":"2022-03-21T13:54:27.557489+0000","last_active":"2022-03-21T13:54:27.557489+0000","last_peered":"2022-03-21T13:54:27.557489+0000","last_clean":"2022-03-21T13:54:27.557489+0000","last_became_active":"2022-03-21T13:54:27.557158+0000","last_became_peered":"2022-03-21T13:54:27.557158+0000","last_unstale":"2022-03-21T13:54:27.557489+0000","last_undegraded":"2022-03-21T13:54:27.557489+0000","last_fullsized":"2022-03-21T13:54:27.557489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:40:54.983646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564403+0000","last_change":"2022-03-21T13:54:27.564403+0000","last_active":"2022-03-21T13:54:27.564403+0000","last_peered":"2022-03-21T13:54:27.564403+0000","last_clean":"2022-03-21T13:54:27.564403+0000","last_became_active":"2022-03-21T13:54:27.564206+0000","last_became_peered":"2022-03-21T13:54:27.564206+0000","last_unstale":"2022-03-21T13:54:27.564403+0000","last_undegraded":"2022-03-21T13:54:27.564403+0000","last_fullsized":"2022-03-21T13:54:27.564403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:59:14.326123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561303+0000","last_change":"2022-03-21T13:54:27.557180+0000","last_active":"2022-03-21T13:54:27.561303+0000","last_peered":"2022-03-21T13:54:27.561303+0000","last_clean":"2022-03-21T13:54:27.561303+0000","last_became_active":"2022-03-21T13:54:27.556920+0000","last_became_peered":"2022-03-21T13:54:27.556920+0000","last_unstale":"2022-03-21T13:54:27.561303+0000","last_undegraded":"2022-03-21T13:54:27.561303+0000","last_fullsized":"2022-03-21T13:54:27.561303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:08:18.086954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.565259+0000","last_change":"2022-03-21T13:54:27.565259+0000","last_active":"2022-03-21T13:54:27.565259+0000","last_peered":"2022-03-21T13:54:27.565259+0000","last_clean":"2022-03-21T13:54:27.565259+0000","last_became_active":"2022-03-21T13:54:27.564920+0000","last_became_peered":"2022-03-21T13:54:27.564920+0000","last_unstale":"2022-03-21T13:54:27.565259+0000","last_undegraded":"2022-03-21T13:54:27.565259+0000","last_fullsized":"2022-03-21T13:54:27.565259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:32:42.928977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556183+0000","last_change":"2022-03-21T13:54:27.553677+0000","last_active":"2022-03-21T13:54:27.556183+0000","last_peered":"2022-03-21T13:54:27.556183+0000","last_clean":"2022-03-21T13:54:27.556183+0000","last_became_active":"2022-03-21T13:54:27.553385+0000","last_became_peered":"2022-03-21T13:54:27.553385+0000","last_unstale":"2022-03-21T13:54:27.556183+0000","last_undegraded":"2022-03-21T13:54:27.556183+0000","last_fullsized":"2022-03-21T13:54:27.556183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:11:07.645677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.558348+0000","last_change":"2022-03-21T13:54:27.558348+0000","last_active":"2022-03-21T13:54:27.558348+0000","last_peered":"2022-03-21T13:54:27.558348+0000","last_clean":"2022-03-21T13:54:27.558348+0000","last_became_active":"2022-03-21T13:54:27.557809+0000","last_became_peered":"2022-03-21T13:54:27.557809+0000","last_unstale":"2022-03-21T13:54:27.558348+0000","last_undegraded":"2022-03-21T13:54:27.558348+0000","last_fullsized":"2022-03-21T13:54:27.558348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:46:38.130496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561257+0000","last_change":"2022-03-21T13:54:27.557849+0000","last_active":"2022-03-21T13:54:27.561257+0000","last_peered":"2022-03-21T13:54:27.561257+0000","last_clean":"2022-03-21T13:54:27.561257+0000","last_became_active":"2022-03-21T13:54:27.557598+0000","last_became_peered":"2022-03-21T13:54:27.557598+0000","last_unstale":"2022-03-21T13:54:27.561257+0000","last_undegraded":"2022-03-21T13:54:27.561257+0000","last_fullsized":"2022-03-21T13:54:27.561257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:02:12.450734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552732+0000","last_change":"2022-03-21T13:54:27.546503+0000","last_active":"2022-03-21T13:54:27.552732+0000","last_peered":"2022-03-21T13:54:27.552732+0000","last_clean":"2022-03-21T13:54:27.552732+0000","last_became_active":"2022-03-21T13:54:27.546206+0000","last_became_peered":"2022-03-21T13:54:27.546206+0000","last_unstale":"2022-03-21T13:54:27.552732+0000","last_undegraded":"2022-03-21T13:54:27.552732+0000","last_fullsized":"2022-03-21T13:54:27.552732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:30:57.355670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561846+0000","last_change":"2022-03-21T13:54:27.556507+0000","last_active":"2022-03-21T13:54:27.561846+0000","last_peered":"2022-03-21T13:54:27.561846+0000","last_clean":"2022-03-21T13:54:27.561846+0000","last_became_active":"2022-03-21T13:54:27.556230+0000","last_became_peered":"2022-03-21T13:54:27.556230+0000","last_unstale":"2022-03-21T13:54:27.561846+0000","last_undegraded":"2022-03-21T13:54:27.561846+0000","last_fullsized":"2022-03-21T13:54:27.561846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:34:35.624406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562378+0000","last_change":"2022-03-21T13:54:27.559880+0000","last_active":"2022-03-21T13:54:27.562378+0000","last_peered":"2022-03-21T13:54:27.562378+0000","last_clean":"2022-03-21T13:54:27.562378+0000","last_became_active":"2022-03-21T13:54:27.559587+0000","last_became_peered":"2022-03-21T13:54:27.559587+0000","last_unstale":"2022-03-21T13:54:27.562378+0000","last_undegraded":"2022-03-21T13:54:27.562378+0000","last_fullsized":"2022-03-21T13:54:27.562378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:25:15.705881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561513+0000","last_change":"2022-03-21T13:54:27.558473+0000","last_active":"2022-03-21T13:54:27.561513+0000","last_peered":"2022-03-21T13:54:27.561513+0000","last_clean":"2022-03-21T13:54:27.561513+0000","last_became_active":"2022-03-21T13:54:27.557800+0000","last_became_peered":"2022-03-21T13:54:27.557800+0000","last_unstale":"2022-03-21T13:54:27.561513+0000","last_undegraded":"2022-03-21T13:54:27.561513+0000","last_fullsized":"2022-03-21T13:54:27.561513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:43:47.336190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.565260+0000","last_change":"2022-03-21T13:54:27.565260+0000","last_active":"2022-03-21T13:54:27.565260+0000","last_peered":"2022-03-21T13:54:27.565260+0000","last_clean":"2022-03-21T13:54:27.565260+0000","last_became_active":"2022-03-21T13:54:27.564955+0000","last_became_peered":"2022-03-21T13:54:27.564955+0000","last_unstale":"2022-03-21T13:54:27.565260+0000","last_undegraded":"2022-03-21T13:54:27.565260+0000","last_fullsized":"2022-03-21T13:54:27.565260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T13:54:36.332945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561411+0000","last_change":"2022-03-21T13:54:27.558826+0000","last_active":"2022-03-21T13:54:27.561411+0000","last_peered":"2022-03-21T13:54:27.561411+0000","last_clean":"2022-03-21T13:54:27.561411+0000","last_became_active":"2022-03-21T13:54:27.558001+0000","last_became_peered":"2022-03-21T13:54:27.558001+0000","last_unstale":"2022-03-21T13:54:27.561411+0000","last_undegraded":"2022-03-21T13:54:27.561411+0000","last_fullsized":"2022-03-21T13:54:27.561411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:09:43.452276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556666+0000","last_change":"2022-03-21T13:54:27.556666+0000","last_active":"2022-03-21T13:54:27.556666+0000","last_peered":"2022-03-21T13:54:27.556666+0000","last_clean":"2022-03-21T13:54:27.556666+0000","last_became_active":"2022-03-21T13:54:27.556355+0000","last_became_peered":"2022-03-21T13:54:27.556355+0000","last_unstale":"2022-03-21T13:54:27.556666+0000","last_undegraded":"2022-03-21T13:54:27.556666+0000","last_fullsized":"2022-03-21T13:54:27.556666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:50:08.704449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561401+0000","last_change":"2022-03-21T13:54:27.558635+0000","last_active":"2022-03-21T13:54:27.561401+0000","last_peered":"2022-03-21T13:54:27.561401+0000","last_clean":"2022-03-21T13:54:27.561401+0000","last_became_active":"2022-03-21T13:54:27.558320+0000","last_became_peered":"2022-03-21T13:54:27.558320+0000","last_unstale":"2022-03-21T13:54:27.561401+0000","last_undegraded":"2022-03-21T13:54:27.561401+0000","last_fullsized":"2022-03-21T13:54:27.561401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:14:17.971078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562412+0000","last_change":"2022-03-21T13:54:27.557412+0000","last_active":"2022-03-21T13:54:27.562412+0000","last_peered":"2022-03-21T13:54:27.562412+0000","last_clean":"2022-03-21T13:54:27.562412+0000","last_became_active":"2022-03-21T13:54:27.557140+0000","last_became_peered":"2022-03-21T13:54:27.557140+0000","last_unstale":"2022-03-21T13:54:27.562412+0000","last_undegraded":"2022-03-21T13:54:27.562412+0000","last_fullsized":"2022-03-21T13:54:27.562412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:14:32.888607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556264+0000","last_change":"2022-03-21T13:54:27.553441+0000","last_active":"2022-03-21T13:54:27.556264+0000","last_peered":"2022-03-21T13:54:27.556264+0000","last_clean":"2022-03-21T13:54:27.556264+0000","last_became_active":"2022-03-21T13:54:27.553027+0000","last_became_peered":"2022-03-21T13:54:27.553027+0000","last_unstale":"2022-03-21T13:54:27.556264+0000","last_undegraded":"2022-03-21T13:54:27.556264+0000","last_fullsized":"2022-03-21T13:54:27.556264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:18:30.624463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563794+0000","last_change":"2022-03-21T13:54:27.563794+0000","last_active":"2022-03-21T13:54:27.563794+0000","last_peered":"2022-03-21T13:54:27.563794+0000","last_clean":"2022-03-21T13:54:27.563794+0000","last_became_active":"2022-03-21T13:54:27.563545+0000","last_became_peered":"2022-03-21T13:54:27.563545+0000","last_unstale":"2022-03-21T13:54:27.563794+0000","last_undegraded":"2022-03-21T13:54:27.563794+0000","last_fullsized":"2022-03-21T13:54:27.563794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:50:55.275326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553387+0000","last_change":"2022-03-21T13:54:27.553387+0000","last_active":"2022-03-21T13:54:27.553387+0000","last_peered":"2022-03-21T13:54:27.553387+0000","last_clean":"2022-03-21T13:54:27.553387+0000","last_became_active":"2022-03-21T13:54:27.553153+0000","last_became_peered":"2022-03-21T13:54:27.553153+0000","last_unstale":"2022-03-21T13:54:27.553387+0000","last_undegraded":"2022-03-21T13:54:27.553387+0000","last_fullsized":"2022-03-21T13:54:27.553387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:50:23.006803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563751+0000","last_change":"2022-03-21T13:54:27.563751+0000","last_active":"2022-03-21T13:54:27.563751+0000","last_peered":"2022-03-21T13:54:27.563751+0000","last_clean":"2022-03-21T13:54:27.563751+0000","last_became_active":"2022-03-21T13:54:27.563500+0000","last_became_peered":"2022-03-21T13:54:27.563500+0000","last_unstale":"2022-03-21T13:54:27.563751+0000","last_undegraded":"2022-03-21T13:54:27.563751+0000","last_fullsized":"2022-03-21T13:54:27.563751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:56:25.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.558999+0000","last_change":"2022-03-21T13:54:27.558999+0000","last_active":"2022-03-21T13:54:27.558999+0000","last_peered":"2022-03-21T13:54:27.558999+0000","last_clean":"2022-03-21T13:54:27.558999+0000","last_became_active":"2022-03-21T13:54:27.558681+0000","last_became_peered":"2022-03-21T13:54:27.558681+0000","last_unstale":"2022-03-21T13:54:27.558999+0000","last_undegraded":"2022-03-21T13:54:27.558999+0000","last_fullsized":"2022-03-21T13:54:27.558999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:42:26.014896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552966+0000","last_change":"2022-03-21T13:54:27.550096+0000","last_active":"2022-03-21T13:54:27.552966+0000","last_peered":"2022-03-21T13:54:27.552966+0000","last_clean":"2022-03-21T13:54:27.552966+0000","last_became_active":"2022-03-21T13:54:27.549821+0000","last_became_peered":"2022-03-21T13:54:27.549821+0000","last_unstale":"2022-03-21T13:54:27.552966+0000","last_undegraded":"2022-03-21T13:54:27.552966+0000","last_fullsized":"2022-03-21T13:54:27.552966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:32:24.498709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563579+0000","last_change":"2022-03-21T13:54:27.561032+0000","last_active":"2022-03-21T13:54:27.563579+0000","last_peered":"2022-03-21T13:54:27.563579+0000","last_clean":"2022-03-21T13:54:27.563579+0000","last_became_active":"2022-03-21T13:54:27.560494+0000","last_became_peered":"2022-03-21T13:54:27.560494+0000","last_unstale":"2022-03-21T13:54:27.563579+0000","last_undegraded":"2022-03-21T13:54:27.563579+0000","last_fullsized":"2022-03-21T13:54:27.563579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:25:56.396980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561291+0000","last_change":"2022-03-21T13:54:27.558917+0000","last_active":"2022-03-21T13:54:27.561291+0000","last_peered":"2022-03-21T13:54:27.561291+0000","last_clean":"2022-03-21T13:54:27.561291+0000","last_became_active":"2022-03-21T13:54:27.556966+0000","last_became_peered":"2022-03-21T13:54:27.556966+0000","last_unstale":"2022-03-21T13:54:27.561291+0000","last_undegraded":"2022-03-21T13:54:27.561291+0000","last_fullsized":"2022-03-21T13:54:27.561291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:43:43.072254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544651+0000","last_change":"2022-03-21T13:54:27.180549+0000","last_active":"2022-03-21T13:54:27.544651+0000","last_peered":"2022-03-21T13:54:27.544651+0000","last_clean":"2022-03-21T13:54:27.544651+0000","last_became_active":"2022-03-21T13:54:27.178977+0000","last_became_peered":"2022-03-21T13:54:27.178977+0000","last_unstale":"2022-03-21T13:54:27.544651+0000","last_undegraded":"2022-03-21T13:54:27.544651+0000","last_fullsized":"2022-03-21T13:54:27.544651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:11:42.262563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546371+0000","last_change":"2022-03-21T13:54:27.546371+0000","last_active":"2022-03-21T13:54:27.546371+0000","last_peered":"2022-03-21T13:54:27.546371+0000","last_clean":"2022-03-21T13:54:27.546371+0000","last_became_active":"2022-03-21T13:54:27.546107+0000","last_became_peered":"2022-03-21T13:54:27.546107+0000","last_unstale":"2022-03-21T13:54:27.546371+0000","last_undegraded":"2022-03-21T13:54:27.546371+0000","last_fullsized":"2022-03-21T13:54:27.546371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:03:31.464752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546952+0000","last_change":"2022-03-21T13:54:27.184281+0000","last_active":"2022-03-21T13:54:27.546952+0000","last_peered":"2022-03-21T13:54:27.546952+0000","last_clean":"2022-03-21T13:54:27.546952+0000","last_became_active":"2022-03-21T13:54:27.183982+0000","last_became_peered":"2022-03-21T13:54:27.183982+0000","last_unstale":"2022-03-21T13:54:27.546952+0000","last_undegraded":"2022-03-21T13:54:27.546952+0000","last_fullsized":"2022-03-21T13:54:27.546952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:05:10.462607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561606+0000","last_change":"2022-03-21T13:54:27.561606+0000","last_active":"2022-03-21T13:54:27.561606+0000","last_peered":"2022-03-21T13:54:27.561606+0000","last_clean":"2022-03-21T13:54:27.561606+0000","last_became_active":"2022-03-21T13:54:27.557656+0000","last_became_peered":"2022-03-21T13:54:27.557656+0000","last_unstale":"2022-03-21T13:54:27.561606+0000","last_undegraded":"2022-03-21T13:54:27.561606+0000","last_fullsized":"2022-03-21T13:54:27.561606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:18:31.529342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.184503+0000","last_change":"2022-03-21T13:54:27.181800+0000","last_active":"2022-03-21T13:54:27.184503+0000","last_peered":"2022-03-21T13:54:27.184503+0000","last_clean":"2022-03-21T13:54:27.184503+0000","last_became_active":"2022-03-21T13:54:27.181378+0000","last_became_peered":"2022-03-21T13:54:27.181378+0000","last_unstale":"2022-03-21T13:54:27.184503+0000","last_undegraded":"2022-03-21T13:54:27.184503+0000","last_fullsized":"2022-03-21T13:54:27.184503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T13:59:13.837451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.547987+0000","last_change":"2022-03-21T13:54:27.547987+0000","last_active":"2022-03-21T13:54:27.547987+0000","last_peered":"2022-03-21T13:54:27.547987+0000","last_clean":"2022-03-21T13:54:27.547987+0000","last_became_active":"2022-03-21T13:54:27.547719+0000","last_became_peered":"2022-03-21T13:54:27.547719+0000","last_unstale":"2022-03-21T13:54:27.547987+0000","last_undegraded":"2022-03-21T13:54:27.547987+0000","last_fullsized":"2022-03-21T13:54:27.547987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:20:42.860191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.185927+0000","last_change":"2022-03-21T13:54:27.177649+0000","last_active":"2022-03-21T13:54:27.185927+0000","last_peered":"2022-03-21T13:54:27.185927+0000","last_clean":"2022-03-21T13:54:27.185927+0000","last_became_active":"2022-03-21T13:54:27.176925+0000","last_became_peered":"2022-03-21T13:54:27.176925+0000","last_unstale":"2022-03-21T13:54:27.185927+0000","last_undegraded":"2022-03-21T13:54:27.185927+0000","last_fullsized":"2022-03-21T13:54:27.185927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:05:31.974802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553129+0000","last_change":"2022-03-21T13:54:27.553129+0000","last_active":"2022-03-21T13:54:27.553129+0000","last_peered":"2022-03-21T13:54:27.553129+0000","last_clean":"2022-03-21T13:54:27.553129+0000","last_became_active":"2022-03-21T13:54:27.552857+0000","last_became_peered":"2022-03-21T13:54:27.552857+0000","last_unstale":"2022-03-21T13:54:27.553129+0000","last_undegraded":"2022-03-21T13:54:27.553129+0000","last_fullsized":"2022-03-21T13:54:27.553129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:49:43.458618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.540230+0000","last_change":"2022-03-21T13:54:27.176726+0000","last_active":"2022-03-21T13:54:27.540230+0000","last_peered":"2022-03-21T13:54:27.540230+0000","last_clean":"2022-03-21T13:54:27.540230+0000","last_became_active":"2022-03-21T13:54:27.176464+0000","last_became_peered":"2022-03-21T13:54:27.176464+0000","last_unstale":"2022-03-21T13:54:27.540230+0000","last_undegraded":"2022-03-21T13:54:27.540230+0000","last_fullsized":"2022-03-21T13:54:27.540230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:01:07.573227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.555953+0000","last_change":"2022-03-21T13:54:27.555953+0000","last_active":"2022-03-21T13:54:27.555953+0000","last_peered":"2022-03-21T13:54:27.555953+0000","last_clean":"2022-03-21T13:54:27.555953+0000","last_became_active":"2022-03-21T13:54:27.555697+0000","last_became_peered":"2022-03-21T13:54:27.555697+0000","last_unstale":"2022-03-21T13:54:27.555953+0000","last_undegraded":"2022-03-21T13:54:27.555953+0000","last_fullsized":"2022-03-21T13:54:27.555953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:04:28.623659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.188297+0000","last_change":"2022-03-21T13:54:27.181859+0000","last_active":"2022-03-21T13:54:27.188297+0000","last_peered":"2022-03-21T13:54:27.188297+0000","last_clean":"2022-03-21T13:54:27.188297+0000","last_became_active":"2022-03-21T13:54:27.181629+0000","last_became_peered":"2022-03-21T13:54:27.181629+0000","last_unstale":"2022-03-21T13:54:27.188297+0000","last_undegraded":"2022-03-21T13:54:27.188297+0000","last_fullsized":"2022-03-21T13:54:27.188297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:24:23.689696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553010+0000","last_change":"2022-03-21T13:54:27.549413+0000","last_active":"2022-03-21T13:54:27.553010+0000","last_peered":"2022-03-21T13:54:27.553010+0000","last_clean":"2022-03-21T13:54:27.553010+0000","last_became_active":"2022-03-21T13:54:27.549162+0000","last_became_peered":"2022-03-21T13:54:27.549162+0000","last_unstale":"2022-03-21T13:54:27.553010+0000","last_undegraded":"2022-03-21T13:54:27.553010+0000","last_fullsized":"2022-03-21T13:54:27.553010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:06:56.454596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544701+0000","last_change":"2022-03-21T13:54:27.181484+0000","last_active":"2022-03-21T13:54:27.544701+0000","last_peered":"2022-03-21T13:54:27.544701+0000","last_clean":"2022-03-21T13:54:27.544701+0000","last_became_active":"2022-03-21T13:54:27.181191+0000","last_became_peered":"2022-03-21T13:54:27.181191+0000","last_unstale":"2022-03-21T13:54:27.544701+0000","last_undegraded":"2022-03-21T13:54:27.544701+0000","last_fullsized":"2022-03-21T13:54:27.544701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:10:19.939317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554603+0000","last_change":"2022-03-21T13:54:27.547927+0000","last_active":"2022-03-21T13:54:27.554603+0000","last_peered":"2022-03-21T13:54:27.554603+0000","last_clean":"2022-03-21T13:54:27.554603+0000","last_became_active":"2022-03-21T13:54:27.547605+0000","last_became_peered":"2022-03-21T13:54:27.547605+0000","last_unstale":"2022-03-21T13:54:27.554603+0000","last_undegraded":"2022-03-21T13:54:27.554603+0000","last_fullsized":"2022-03-21T13:54:27.554603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:57:24.920256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.191096+0000","last_change":"2022-03-21T13:54:27.183437+0000","last_active":"2022-03-21T13:54:27.191096+0000","last_peered":"2022-03-21T13:54:27.191096+0000","last_clean":"2022-03-21T13:54:27.191096+0000","last_became_active":"2022-03-21T13:54:27.183118+0000","last_became_peered":"2022-03-21T13:54:27.183118+0000","last_unstale":"2022-03-21T13:54:27.191096+0000","last_undegraded":"2022-03-21T13:54:27.191096+0000","last_fullsized":"2022-03-21T13:54:27.191096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:46:16.301549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553692+0000","last_change":"2022-03-21T13:54:27.553692+0000","last_active":"2022-03-21T13:54:27.553692+0000","last_peered":"2022-03-21T13:54:27.553692+0000","last_clean":"2022-03-21T13:54:27.553692+0000","last_became_active":"2022-03-21T13:54:27.553419+0000","last_became_peered":"2022-03-21T13:54:27.553419+0000","last_unstale":"2022-03-21T13:54:27.553692+0000","last_undegraded":"2022-03-21T13:54:27.553692+0000","last_fullsized":"2022-03-21T13:54:27.553692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:47:02.533721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.185952+0000","last_change":"2022-03-21T13:54:27.179452+0000","last_active":"2022-03-21T13:54:27.185952+0000","last_peered":"2022-03-21T13:54:27.185952+0000","last_clean":"2022-03-21T13:54:27.185952+0000","last_became_active":"2022-03-21T13:54:27.177655+0000","last_became_peered":"2022-03-21T13:54:27.177655+0000","last_unstale":"2022-03-21T13:54:27.185952+0000","last_undegraded":"2022-03-21T13:54:27.185952+0000","last_fullsized":"2022-03-21T13:54:27.185952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:42:43.049495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561270+0000","last_change":"2022-03-21T13:54:27.557989+0000","last_active":"2022-03-21T13:54:27.561270+0000","last_peered":"2022-03-21T13:54:27.561270+0000","last_clean":"2022-03-21T13:54:27.561270+0000","last_became_active":"2022-03-21T13:54:27.557346+0000","last_became_peered":"2022-03-21T13:54:27.557346+0000","last_unstale":"2022-03-21T13:54:27.561270+0000","last_undegraded":"2022-03-21T13:54:27.561270+0000","last_fullsized":"2022-03-21T13:54:27.561270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:54:09.949225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.180492+0000","last_change":"2022-03-21T13:54:27.177423+0000","last_active":"2022-03-21T13:54:27.180492+0000","last_peered":"2022-03-21T13:54:27.180492+0000","last_clean":"2022-03-21T13:54:27.180492+0000","last_became_active":"2022-03-21T13:54:27.177050+0000","last_became_peered":"2022-03-21T13:54:27.177050+0000","last_unstale":"2022-03-21T13:54:27.180492+0000","last_undegraded":"2022-03-21T13:54:27.180492+0000","last_fullsized":"2022-03-21T13:54:27.180492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:03:05.301157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557999+0000","last_change":"2022-03-21T13:54:27.557999+0000","last_active":"2022-03-21T13:54:27.557999+0000","last_peered":"2022-03-21T13:54:27.557999+0000","last_clean":"2022-03-21T13:54:27.557999+0000","last_became_active":"2022-03-21T13:54:27.557001+0000","last_became_peered":"2022-03-21T13:54:27.557001+0000","last_unstale":"2022-03-21T13:54:27.557999+0000","last_undegraded":"2022-03-21T13:54:27.557999+0000","last_fullsized":"2022-03-21T13:54:27.557999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:44:28.857826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.188282+0000","last_change":"2022-03-21T13:54:27.184135+0000","last_active":"2022-03-21T13:54:27.188282+0000","last_peered":"2022-03-21T13:54:27.188282+0000","last_clean":"2022-03-21T13:54:27.188282+0000","last_became_active":"2022-03-21T13:54:27.183892+0000","last_became_peered":"2022-03-21T13:54:27.183892+0000","last_unstale":"2022-03-21T13:54:27.188282+0000","last_undegraded":"2022-03-21T13:54:27.188282+0000","last_fullsized":"2022-03-21T13:54:27.188282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:44:30.017340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559857+0000","last_change":"2022-03-21T13:54:27.559857+0000","last_active":"2022-03-21T13:54:27.559857+0000","last_peered":"2022-03-21T13:54:27.559857+0000","last_clean":"2022-03-21T13:54:27.559857+0000","last_became_active":"2022-03-21T13:54:27.559336+0000","last_became_peered":"2022-03-21T13:54:27.559336+0000","last_unstale":"2022-03-21T13:54:27.559857+0000","last_undegraded":"2022-03-21T13:54:27.559857+0000","last_fullsized":"2022-03-21T13:54:27.559857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:43:12.014350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.180459+0000","last_change":"2022-03-21T13:54:27.178818+0000","last_active":"2022-03-21T13:54:27.180459+0000","last_peered":"2022-03-21T13:54:27.180459+0000","last_clean":"2022-03-21T13:54:27.180459+0000","last_became_active":"2022-03-21T13:54:27.178542+0000","last_became_peered":"2022-03-21T13:54:27.178542+0000","last_unstale":"2022-03-21T13:54:27.180459+0000","last_undegraded":"2022-03-21T13:54:27.180459+0000","last_fullsized":"2022-03-21T13:54:27.180459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:45:39.568015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.560603+0000","last_change":"2022-03-21T13:54:27.555377+0000","last_active":"2022-03-21T13:54:27.560603+0000","last_peered":"2022-03-21T13:54:27.560603+0000","last_clean":"2022-03-21T13:54:27.560603+0000","last_became_active":"2022-03-21T13:54:27.555080+0000","last_became_peered":"2022-03-21T13:54:27.555080+0000","last_unstale":"2022-03-21T13:54:27.560603+0000","last_undegraded":"2022-03-21T13:54:27.560603+0000","last_fullsized":"2022-03-21T13:54:27.560603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:16:31.684909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.179623+0000","last_change":"2022-03-21T13:54:27.175755+0000","last_active":"2022-03-21T13:54:27.179623+0000","last_peered":"2022-03-21T13:54:27.179623+0000","last_clean":"2022-03-21T13:54:27.179623+0000","last_became_active":"2022-03-21T13:54:27.175442+0000","last_became_peered":"2022-03-21T13:54:27.175442+0000","last_unstale":"2022-03-21T13:54:27.179623+0000","last_undegraded":"2022-03-21T13:54:27.179623+0000","last_fullsized":"2022-03-21T13:54:27.179623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:21:41.935690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559410+0000","last_change":"2022-03-21T13:54:27.555167+0000","last_active":"2022-03-21T13:54:27.559410+0000","last_peered":"2022-03-21T13:54:27.559410+0000","last_clean":"2022-03-21T13:54:27.559410+0000","last_became_active":"2022-03-21T13:54:27.554856+0000","last_became_peered":"2022-03-21T13:54:27.554856+0000","last_unstale":"2022-03-21T13:54:27.559410+0000","last_undegraded":"2022-03-21T13:54:27.559410+0000","last_fullsized":"2022-03-21T13:54:27.559410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:57:23.684151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.179729+0000","last_change":"2022-03-21T13:54:27.176740+0000","last_active":"2022-03-21T13:54:27.179729+0000","last_peered":"2022-03-21T13:54:27.179729+0000","last_clean":"2022-03-21T13:54:27.179729+0000","last_became_active":"2022-03-21T13:54:27.176438+0000","last_became_peered":"2022-03-21T13:54:27.176438+0000","last_unstale":"2022-03-21T13:54:27.179729+0000","last_undegraded":"2022-03-21T13:54:27.179729+0000","last_fullsized":"2022-03-21T13:54:27.179729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:30:43.910676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546515+0000","last_change":"2022-03-21T13:54:27.546515+0000","last_active":"2022-03-21T13:54:27.546515+0000","last_peered":"2022-03-21T13:54:27.546515+0000","last_clean":"2022-03-21T13:54:27.546515+0000","last_became_active":"2022-03-21T13:54:27.546277+0000","last_became_peered":"2022-03-21T13:54:27.546277+0000","last_unstale":"2022-03-21T13:54:27.546515+0000","last_undegraded":"2022-03-21T13:54:27.546515+0000","last_fullsized":"2022-03-21T13:54:27.546515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:55:14.541373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538652+0000","last_change":"2022-03-21T13:54:27.173718+0000","last_active":"2022-03-21T13:54:27.538652+0000","last_peered":"2022-03-21T13:54:27.538652+0000","last_clean":"2022-03-21T13:54:27.538652+0000","last_became_active":"2022-03-21T13:54:27.173384+0000","last_became_peered":"2022-03-21T13:54:27.173384+0000","last_unstale":"2022-03-21T13:54:27.538652+0000","last_undegraded":"2022-03-21T13:54:27.538652+0000","last_fullsized":"2022-03-21T13:54:27.538652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:27:30.485761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553332+0000","last_change":"2022-03-21T13:54:27.553332+0000","last_active":"2022-03-21T13:54:27.553332+0000","last_peered":"2022-03-21T13:54:27.553332+0000","last_clean":"2022-03-21T13:54:27.553332+0000","last_became_active":"2022-03-21T13:54:27.553052+0000","last_became_peered":"2022-03-21T13:54:27.553052+0000","last_unstale":"2022-03-21T13:54:27.553332+0000","last_undegraded":"2022-03-21T13:54:27.553332+0000","last_fullsized":"2022-03-21T13:54:27.553332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:04:17.341255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.183779+0000","last_change":"2022-03-21T13:54:27.181423+0000","last_active":"2022-03-21T13:54:27.183779+0000","last_peered":"2022-03-21T13:54:27.183779+0000","last_clean":"2022-03-21T13:54:27.183779+0000","last_became_active":"2022-03-21T13:54:27.181127+0000","last_became_peered":"2022-03-21T13:54:27.181127+0000","last_unstale":"2022-03-21T13:54:27.183779+0000","last_undegraded":"2022-03-21T13:54:27.183779+0000","last_fullsized":"2022-03-21T13:54:27.183779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:17:46.749032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556245+0000","last_change":"2022-03-21T13:54:27.553277+0000","last_active":"2022-03-21T13:54:27.556245+0000","last_peered":"2022-03-21T13:54:27.556245+0000","last_clean":"2022-03-21T13:54:27.556245+0000","last_became_active":"2022-03-21T13:54:27.552711+0000","last_became_peered":"2022-03-21T13:54:27.552711+0000","last_unstale":"2022-03-21T13:54:27.556245+0000","last_undegraded":"2022-03-21T13:54:27.556245+0000","last_fullsized":"2022-03-21T13:54:27.556245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:18:24.656738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.191227+0000","last_change":"2022-03-21T13:54:27.188996+0000","last_active":"2022-03-21T13:54:27.191227+0000","last_peered":"2022-03-21T13:54:27.191227+0000","last_clean":"2022-03-21T13:54:27.191227+0000","last_became_active":"2022-03-21T13:54:27.188638+0000","last_became_peered":"2022-03-21T13:54:27.188638+0000","last_unstale":"2022-03-21T13:54:27.191227+0000","last_undegraded":"2022-03-21T13:54:27.191227+0000","last_fullsized":"2022-03-21T13:54:27.191227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:49:19.960076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561350+0000","last_change":"2022-03-21T13:54:27.557724+0000","last_active":"2022-03-21T13:54:27.561350+0000","last_peered":"2022-03-21T13:54:27.561350+0000","last_clean":"2022-03-21T13:54:27.561350+0000","last_became_active":"2022-03-21T13:54:27.557422+0000","last_became_peered":"2022-03-21T13:54:27.557422+0000","last_unstale":"2022-03-21T13:54:27.561350+0000","last_undegraded":"2022-03-21T13:54:27.561350+0000","last_fullsized":"2022-03-21T13:54:27.561350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:34:17.342191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544789+0000","last_change":"2022-03-21T13:54:27.175632+0000","last_active":"2022-03-21T13:54:27.544789+0000","last_peered":"2022-03-21T13:54:27.544789+0000","last_clean":"2022-03-21T13:54:27.544789+0000","last_became_active":"2022-03-21T13:54:27.174313+0000","last_became_peered":"2022-03-21T13:54:27.174313+0000","last_unstale":"2022-03-21T13:54:27.544789+0000","last_undegraded":"2022-03-21T13:54:27.544789+0000","last_fullsized":"2022-03-21T13:54:27.544789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:31:14.846155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556557+0000","last_change":"2022-03-21T13:54:27.553933+0000","last_active":"2022-03-21T13:54:27.556557+0000","last_peered":"2022-03-21T13:54:27.556557+0000","last_clean":"2022-03-21T13:54:27.556557+0000","last_became_active":"2022-03-21T13:54:27.553667+0000","last_became_peered":"2022-03-21T13:54:27.553667+0000","last_unstale":"2022-03-21T13:54:27.556557+0000","last_undegraded":"2022-03-21T13:54:27.556557+0000","last_fullsized":"2022-03-21T13:54:27.556557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:51:01.974225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.184482+0000","last_change":"2022-03-21T13:54:27.181656+0000","last_active":"2022-03-21T13:54:27.184482+0000","last_peered":"2022-03-21T13:54:27.184482+0000","last_clean":"2022-03-21T13:54:27.184482+0000","last_became_active":"2022-03-21T13:54:27.181013+0000","last_became_peered":"2022-03-21T13:54:27.181013+0000","last_unstale":"2022-03-21T13:54:27.184482+0000","last_undegraded":"2022-03-21T13:54:27.184482+0000","last_fullsized":"2022-03-21T13:54:27.184482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:08:16.370281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559632+0000","last_change":"2022-03-21T13:54:27.552507+0000","last_active":"2022-03-21T13:54:27.559632+0000","last_peered":"2022-03-21T13:54:27.559632+0000","last_clean":"2022-03-21T13:54:27.559632+0000","last_became_active":"2022-03-21T13:54:27.552244+0000","last_became_peered":"2022-03-21T13:54:27.552244+0000","last_unstale":"2022-03-21T13:54:27.559632+0000","last_undegraded":"2022-03-21T13:54:27.559632+0000","last_fullsized":"2022-03-21T13:54:27.559632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:15:46.905402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.184000+0000","last_change":"2022-03-21T13:54:27.182220+0000","last_active":"2022-03-21T13:54:27.184000+0000","last_peered":"2022-03-21T13:54:27.184000+0000","last_clean":"2022-03-21T13:54:27.184000+0000","last_became_active":"2022-03-21T13:54:27.181449+0000","last_became_peered":"2022-03-21T13:54:27.181449+0000","last_unstale":"2022-03-21T13:54:27.184000+0000","last_undegraded":"2022-03-21T13:54:27.184000+0000","last_fullsized":"2022-03-21T13:54:27.184000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:26:28.829484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544372+0000","last_change":"2022-03-21T13:54:22.752657+0000","last_active":"2022-03-21T13:54:27.544372+0000","last_peered":"2022-03-21T13:54:27.544372+0000","last_clean":"2022-03-21T13:54:27.544372+0000","last_became_active":"2022-03-21T13:54:22.752340+0000","last_became_peered":"2022-03-21T13:54:22.752340+0000","last_unstale":"2022-03-21T13:54:27.544372+0000","last_undegraded":"2022-03-21T13:54:27.544372+0000","last_fullsized":"2022-03-21T13:54:27.544372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:28:57.302130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556126+0000","last_change":"2022-03-21T13:54:27.556126+0000","last_active":"2022-03-21T13:54:27.556126+0000","last_peered":"2022-03-21T13:54:27.556126+0000","last_clean":"2022-03-21T13:54:27.556126+0000","last_became_active":"2022-03-21T13:54:27.555851+0000","last_became_peered":"2022-03-21T13:54:27.555851+0000","last_unstale":"2022-03-21T13:54:27.556126+0000","last_undegraded":"2022-03-21T13:54:27.556126+0000","last_fullsized":"2022-03-21T13:54:27.556126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:16:33.357705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.164372+0000","last_change":"2022-03-21T13:54:22.516271+0000","last_active":"2022-03-21T13:54:27.164372+0000","last_peered":"2022-03-21T13:54:27.164372+0000","last_clean":"2022-03-21T13:54:27.164372+0000","last_became_active":"2022-03-21T13:54:22.516054+0000","last_became_peered":"2022-03-21T13:54:22.516054+0000","last_unstale":"2022-03-21T13:54:27.164372+0000","last_undegraded":"2022-03-21T13:54:27.164372+0000","last_fullsized":"2022-03-21T13:54:27.164372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:22:14.145694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.186006+0000","last_change":"2022-03-21T13:54:27.180161+0000","last_active":"2022-03-21T13:54:27.186006+0000","last_peered":"2022-03-21T13:54:27.186006+0000","last_clean":"2022-03-21T13:54:27.186006+0000","last_became_active":"2022-03-21T13:54:27.179861+0000","last_became_peered":"2022-03-21T13:54:27.179861+0000","last_unstale":"2022-03-21T13:54:27.186006+0000","last_undegraded":"2022-03-21T13:54:27.186006+0000","last_fullsized":"2022-03-21T13:54:27.186006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:54:59.570703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559390+0000","last_change":"2022-03-21T13:54:27.554664+0000","last_active":"2022-03-21T13:54:27.559390+0000","last_peered":"2022-03-21T13:54:27.559390+0000","last_clean":"2022-03-21T13:54:27.559390+0000","last_became_active":"2022-03-21T13:54:27.554348+0000","last_became_peered":"2022-03-21T13:54:27.554348+0000","last_unstale":"2022-03-21T13:54:27.559390+0000","last_undegraded":"2022-03-21T13:54:27.559390+0000","last_fullsized":"2022-03-21T13:54:27.559390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:57:45.927949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546570+0000","last_change":"2022-03-21T13:54:22.517332+0000","last_active":"2022-03-21T13:54:27.546570+0000","last_peered":"2022-03-21T13:54:27.546570+0000","last_clean":"2022-03-21T13:54:27.546570+0000","last_became_active":"2022-03-21T13:54:22.517041+0000","last_became_peered":"2022-03-21T13:54:22.517041+0000","last_unstale":"2022-03-21T13:54:27.546570+0000","last_undegraded":"2022-03-21T13:54:27.546570+0000","last_fullsized":"2022-03-21T13:54:27.546570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:35:30.629523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":162,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.168109+0000","last_change":"2022-03-21T13:54:22.518907+0000","last_active":"2022-03-21T13:54:27.168109+0000","last_peered":"2022-03-21T13:54:27.168109+0000","last_clean":"2022-03-21T13:54:27.168109+0000","last_became_active":"2022-03-21T13:54:22.518133+0000","last_became_peered":"2022-03-21T13:54:22.518133+0000","last_unstale":"2022-03-21T13:54:27.168109+0000","last_undegraded":"2022-03-21T13:54:27.168109+0000","last_fullsized":"2022-03-21T13:54:27.168109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:30:34.855709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.183345+0000","last_change":"2022-03-21T13:54:27.176117+0000","last_active":"2022-03-21T13:54:27.183345+0000","last_peered":"2022-03-21T13:54:27.183345+0000","last_clean":"2022-03-21T13:54:27.183345+0000","last_became_active":"2022-03-21T13:54:27.175777+0000","last_became_peered":"2022-03-21T13:54:27.175777+0000","last_unstale":"2022-03-21T13:54:27.183345+0000","last_undegraded":"2022-03-21T13:54:27.183345+0000","last_fullsized":"2022-03-21T13:54:27.183345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:10:54.616279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557887+0000","last_change":"2022-03-21T13:54:27.557887+0000","last_active":"2022-03-21T13:54:27.557887+0000","last_peered":"2022-03-21T13:54:27.557887+0000","last_clean":"2022-03-21T13:54:27.557887+0000","last_became_active":"2022-03-21T13:54:27.556863+0000","last_became_peered":"2022-03-21T13:54:27.556863+0000","last_unstale":"2022-03-21T13:54:27.557887+0000","last_undegraded":"2022-03-21T13:54:27.557887+0000","last_fullsized":"2022-03-21T13:54:27.557887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:12:33.174945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.168430+0000","last_change":"2022-03-21T13:54:22.754462+0000","last_active":"2022-03-21T13:54:27.168430+0000","last_peered":"2022-03-21T13:54:27.168430+0000","last_clean":"2022-03-21T13:54:27.168430+0000","last_became_active":"2022-03-21T13:54:22.754181+0000","last_became_peered":"2022-03-21T13:54:22.754181+0000","last_unstale":"2022-03-21T13:54:27.168430+0000","last_undegraded":"2022-03-21T13:54:27.168430+0000","last_fullsized":"2022-03-21T13:54:27.168430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:14:20.288360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.545206+0000","last_change":"2022-03-21T13:54:27.179213+0000","last_active":"2022-03-21T13:54:27.545206+0000","last_peered":"2022-03-21T13:54:27.545206+0000","last_clean":"2022-03-21T13:54:27.545206+0000","last_became_active":"2022-03-21T13:54:27.178915+0000","last_became_peered":"2022-03-21T13:54:27.178915+0000","last_unstale":"2022-03-21T13:54:27.545206+0000","last_undegraded":"2022-03-21T13:54:27.545206+0000","last_fullsized":"2022-03-21T13:54:27.545206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:13:42.024350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552944+0000","last_change":"2022-03-21T13:54:27.547854+0000","last_active":"2022-03-21T13:54:27.552944+0000","last_peered":"2022-03-21T13:54:27.552944+0000","last_clean":"2022-03-21T13:54:27.552944+0000","last_became_active":"2022-03-21T13:54:27.547604+0000","last_became_peered":"2022-03-21T13:54:27.547604+0000","last_unstale":"2022-03-21T13:54:27.552944+0000","last_undegraded":"2022-03-21T13:54:27.552944+0000","last_fullsized":"2022-03-21T13:54:27.552944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:32:19.271632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.167985+0000","last_change":"2022-03-21T13:54:22.754729+0000","last_active":"2022-03-21T13:54:27.167985+0000","last_peered":"2022-03-21T13:54:27.167985+0000","last_clean":"2022-03-21T13:54:27.167985+0000","last_became_active":"2022-03-21T13:54:22.754461+0000","last_became_peered":"2022-03-21T13:54:22.754461+0000","last_unstale":"2022-03-21T13:54:27.167985+0000","last_undegraded":"2022-03-21T13:54:27.167985+0000","last_fullsized":"2022-03-21T13:54:27.167985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:46:22.855169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.180680+0000","last_change":"2022-03-21T13:54:27.174663+0000","last_active":"2022-03-21T13:54:27.180680+0000","last_peered":"2022-03-21T13:54:27.180680+0000","last_clean":"2022-03-21T13:54:27.180680+0000","last_became_active":"2022-03-21T13:54:27.174374+0000","last_became_peered":"2022-03-21T13:54:27.174374+0000","last_unstale":"2022-03-21T13:54:27.180680+0000","last_undegraded":"2022-03-21T13:54:27.180680+0000","last_fullsized":"2022-03-21T13:54:27.180680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:56:26.094511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554233+0000","last_change":"2022-03-21T13:54:27.554233+0000","last_active":"2022-03-21T13:54:27.554233+0000","last_peered":"2022-03-21T13:54:27.554233+0000","last_clean":"2022-03-21T13:54:27.554233+0000","last_became_active":"2022-03-21T13:54:27.554000+0000","last_became_peered":"2022-03-21T13:54:27.554000+0000","last_unstale":"2022-03-21T13:54:27.554233+0000","last_undegraded":"2022-03-21T13:54:27.554233+0000","last_fullsized":"2022-03-21T13:54:27.554233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:06:56.350790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.539757+0000","last_change":"2022-03-21T13:54:22.754834+0000","last_active":"2022-03-21T13:54:27.539757+0000","last_peered":"2022-03-21T13:54:27.539757+0000","last_clean":"2022-03-21T13:54:27.539757+0000","last_became_active":"2022-03-21T13:54:22.754559+0000","last_became_peered":"2022-03-21T13:54:22.754559+0000","last_unstale":"2022-03-21T13:54:27.539757+0000","last_undegraded":"2022-03-21T13:54:27.539757+0000","last_fullsized":"2022-03-21T13:54:27.539757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:12:50.878537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544326+0000","last_change":"2022-03-21T13:54:27.181111+0000","last_active":"2022-03-21T13:54:27.544326+0000","last_peered":"2022-03-21T13:54:27.544326+0000","last_clean":"2022-03-21T13:54:27.544326+0000","last_became_active":"2022-03-21T13:54:27.180843+0000","last_became_peered":"2022-03-21T13:54:27.180843+0000","last_unstale":"2022-03-21T13:54:27.544326+0000","last_undegraded":"2022-03-21T13:54:27.544326+0000","last_fullsized":"2022-03-21T13:54:27.544326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:59:38.064620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563441+0000","last_change":"2022-03-21T13:54:27.559540+0000","last_active":"2022-03-21T13:54:27.563441+0000","last_peered":"2022-03-21T13:54:27.563441+0000","last_clean":"2022-03-21T13:54:27.563441+0000","last_became_active":"2022-03-21T13:54:27.559138+0000","last_became_peered":"2022-03-21T13:54:27.559138+0000","last_unstale":"2022-03-21T13:54:27.563441+0000","last_undegraded":"2022-03-21T13:54:27.563441+0000","last_fullsized":"2022-03-21T13:54:27.563441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:00:54.639756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.172900+0000","last_change":"2022-03-21T13:54:22.754654+0000","last_active":"2022-03-21T13:54:27.172900+0000","last_peered":"2022-03-21T13:54:27.172900+0000","last_clean":"2022-03-21T13:54:27.172900+0000","last_became_active":"2022-03-21T13:54:22.754341+0000","last_became_peered":"2022-03-21T13:54:22.754341+0000","last_unstale":"2022-03-21T13:54:27.172900+0000","last_undegraded":"2022-03-21T13:54:27.172900+0000","last_fullsized":"2022-03-21T13:54:27.172900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:03:23.378195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.545941+0000","last_change":"2022-03-21T13:54:27.177438+0000","last_active":"2022-03-21T13:54:27.545941+0000","last_peered":"2022-03-21T13:54:27.545941+0000","last_clean":"2022-03-21T13:54:27.545941+0000","last_became_active":"2022-03-21T13:54:27.177162+0000","last_became_peered":"2022-03-21T13:54:27.177162+0000","last_unstale":"2022-03-21T13:54:27.545941+0000","last_undegraded":"2022-03-21T13:54:27.545941+0000","last_fullsized":"2022-03-21T13:54:27.545941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:28:43.052052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561906+0000","last_change":"2022-03-21T13:54:27.561906+0000","last_active":"2022-03-21T13:54:27.561906+0000","last_peered":"2022-03-21T13:54:27.561906+0000","last_clean":"2022-03-21T13:54:27.561906+0000","last_became_active":"2022-03-21T13:54:27.561625+0000","last_became_peered":"2022-03-21T13:54:27.561625+0000","last_unstale":"2022-03-21T13:54:27.561906+0000","last_undegraded":"2022-03-21T13:54:27.561906+0000","last_fullsized":"2022-03-21T13:54:27.561906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:56:25.047015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.173128+0000","last_change":"2022-03-21T13:54:22.516420+0000","last_active":"2022-03-21T13:54:27.173128+0000","last_peered":"2022-03-21T13:54:27.173128+0000","last_clean":"2022-03-21T13:54:27.173128+0000","last_became_active":"2022-03-21T13:54:22.516110+0000","last_became_peered":"2022-03-21T13:54:22.516110+0000","last_unstale":"2022-03-21T13:54:27.173128+0000","last_undegraded":"2022-03-21T13:54:27.173128+0000","last_fullsized":"2022-03-21T13:54:27.173128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:05:13.607013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.539334+0000","last_change":"2022-03-21T13:54:27.173580+0000","last_active":"2022-03-21T13:54:27.539334+0000","last_peered":"2022-03-21T13:54:27.539334+0000","last_clean":"2022-03-21T13:54:27.539334+0000","last_became_active":"2022-03-21T13:54:27.173258+0000","last_became_peered":"2022-03-21T13:54:27.173258+0000","last_unstale":"2022-03-21T13:54:27.539334+0000","last_undegraded":"2022-03-21T13:54:27.539334+0000","last_fullsized":"2022-03-21T13:54:27.539334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:47:44.915765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552991+0000","last_change":"2022-03-21T13:54:27.548735+0000","last_active":"2022-03-21T13:54:27.552991+0000","last_peered":"2022-03-21T13:54:27.552991+0000","last_clean":"2022-03-21T13:54:27.552991+0000","last_became_active":"2022-03-21T13:54:27.548473+0000","last_became_peered":"2022-03-21T13:54:27.548473+0000","last_unstale":"2022-03-21T13:54:27.552991+0000","last_undegraded":"2022-03-21T13:54:27.552991+0000","last_fullsized":"2022-03-21T13:54:27.552991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:39:55.442576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.190291+0000","last_change":"2022-03-21T13:54:27.189213+0000","last_active":"2022-03-21T13:54:27.190291+0000","last_peered":"2022-03-21T13:54:27.190291+0000","last_clean":"2022-03-21T13:54:27.190291+0000","last_became_active":"2022-03-21T13:54:27.188926+0000","last_became_peered":"2022-03-21T13:54:27.188926+0000","last_unstale":"2022-03-21T13:54:27.190291+0000","last_undegraded":"2022-03-21T13:54:27.190291+0000","last_fullsized":"2022-03-21T13:54:27.190291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:16:55.866231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561826+0000","last_change":"2022-03-21T13:54:27.556471+0000","last_active":"2022-03-21T13:54:27.561826+0000","last_peered":"2022-03-21T13:54:27.561826+0000","last_clean":"2022-03-21T13:54:27.561826+0000","last_became_active":"2022-03-21T13:54:27.556191+0000","last_became_peered":"2022-03-21T13:54:27.556191+0000","last_unstale":"2022-03-21T13:54:27.561826+0000","last_undegraded":"2022-03-21T13:54:27.561826+0000","last_fullsized":"2022-03-21T13:54:27.561826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:05:34.443958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538479+0000","last_change":"2022-03-21T13:54:27.177405+0000","last_active":"2022-03-21T13:54:27.538479+0000","last_peered":"2022-03-21T13:54:27.538479+0000","last_clean":"2022-03-21T13:54:27.538479+0000","last_became_active":"2022-03-21T13:54:27.177179+0000","last_became_peered":"2022-03-21T13:54:27.177179+0000","last_unstale":"2022-03-21T13:54:27.538479+0000","last_undegraded":"2022-03-21T13:54:27.538479+0000","last_fullsized":"2022-03-21T13:54:27.538479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:41:46.492410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556386+0000","last_change":"2022-03-21T13:54:27.552397+0000","last_active":"2022-03-21T13:54:27.556386+0000","last_peered":"2022-03-21T13:54:27.556386+0000","last_clean":"2022-03-21T13:54:27.556386+0000","last_became_active":"2022-03-21T13:54:27.552124+0000","last_became_peered":"2022-03-21T13:54:27.552124+0000","last_unstale":"2022-03-21T13:54:27.556386+0000","last_undegraded":"2022-03-21T13:54:27.556386+0000","last_fullsized":"2022-03-21T13:54:27.556386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:53:44.559771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.539435+0000","last_change":"2022-03-21T13:54:27.174486+0000","last_active":"2022-03-21T13:54:27.539435+0000","last_peered":"2022-03-21T13:54:27.539435+0000","last_clean":"2022-03-21T13:54:27.539435+0000","last_became_active":"2022-03-21T13:54:27.174216+0000","last_became_peered":"2022-03-21T13:54:27.174216+0000","last_unstale":"2022-03-21T13:54:27.539435+0000","last_undegraded":"2022-03-21T13:54:27.539435+0000","last_fullsized":"2022-03-21T13:54:27.539435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:48:33.845336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552669+0000","last_change":"2022-03-21T13:54:27.545286+0000","last_active":"2022-03-21T13:54:27.552669+0000","last_peered":"2022-03-21T13:54:27.552669+0000","last_clean":"2022-03-21T13:54:27.552669+0000","last_became_active":"2022-03-21T13:54:27.544961+0000","last_became_peered":"2022-03-21T13:54:27.544961+0000","last_unstale":"2022-03-21T13:54:27.552669+0000","last_undegraded":"2022-03-21T13:54:27.552669+0000","last_fullsized":"2022-03-21T13:54:27.552669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:48:39.601897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.183314+0000","last_change":"2022-03-21T13:54:27.178370+0000","last_active":"2022-03-21T13:54:27.183314+0000","last_peered":"2022-03-21T13:54:27.183314+0000","last_clean":"2022-03-21T13:54:27.183314+0000","last_became_active":"2022-03-21T13:54:27.178080+0000","last_became_peered":"2022-03-21T13:54:27.178080+0000","last_unstale":"2022-03-21T13:54:27.183314+0000","last_undegraded":"2022-03-21T13:54:27.183314+0000","last_fullsized":"2022-03-21T13:54:27.183314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:27:35.506923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557416+0000","last_change":"2022-03-21T13:54:27.557416+0000","last_active":"2022-03-21T13:54:27.557416+0000","last_peered":"2022-03-21T13:54:27.557416+0000","last_clean":"2022-03-21T13:54:27.557416+0000","last_became_active":"2022-03-21T13:54:27.557109+0000","last_became_peered":"2022-03-21T13:54:27.557109+0000","last_unstale":"2022-03-21T13:54:27.557416+0000","last_undegraded":"2022-03-21T13:54:27.557416+0000","last_fullsized":"2022-03-21T13:54:27.557416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:54:56.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.183503+0000","last_change":"2022-03-21T13:54:27.177642+0000","last_active":"2022-03-21T13:54:27.183503+0000","last_peered":"2022-03-21T13:54:27.183503+0000","last_clean":"2022-03-21T13:54:27.183503+0000","last_became_active":"2022-03-21T13:54:27.176415+0000","last_became_peered":"2022-03-21T13:54:27.176415+0000","last_unstale":"2022-03-21T13:54:27.183503+0000","last_undegraded":"2022-03-21T13:54:27.183503+0000","last_fullsized":"2022-03-21T13:54:27.183503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:07:20.332858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554536+0000","last_change":"2022-03-21T13:54:27.548038+0000","last_active":"2022-03-21T13:54:27.554536+0000","last_peered":"2022-03-21T13:54:27.554536+0000","last_clean":"2022-03-21T13:54:27.554536+0000","last_became_active":"2022-03-21T13:54:27.547693+0000","last_became_peered":"2022-03-21T13:54:27.547693+0000","last_unstale":"2022-03-21T13:54:27.554536+0000","last_undegraded":"2022-03-21T13:54:27.554536+0000","last_fullsized":"2022-03-21T13:54:27.554536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:20:34.987871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557329+0000","last_change":"2022-03-21T13:54:27.557329+0000","last_active":"2022-03-21T13:54:27.557329+0000","last_peered":"2022-03-21T13:54:27.557329+0000","last_clean":"2022-03-21T13:54:27.557329+0000","last_became_active":"2022-03-21T13:54:27.557050+0000","last_became_peered":"2022-03-21T13:54:27.557050+0000","last_unstale":"2022-03-21T13:54:27.557329+0000","last_undegraded":"2022-03-21T13:54:27.557329+0000","last_fullsized":"2022-03-21T13:54:27.557329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:29:21.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554172+0000","last_change":"2022-03-21T13:54:27.554172+0000","last_active":"2022-03-21T13:54:27.554172+0000","last_peered":"2022-03-21T13:54:27.554172+0000","last_clean":"2022-03-21T13:54:27.554172+0000","last_became_active":"2022-03-21T13:54:27.553846+0000","last_became_peered":"2022-03-21T13:54:27.553846+0000","last_unstale":"2022-03-21T13:54:27.554172+0000","last_undegraded":"2022-03-21T13:54:27.554172+0000","last_fullsized":"2022-03-21T13:54:27.554172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:26:44.119561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554578+0000","last_change":"2022-03-21T13:54:27.547824+0000","last_active":"2022-03-21T13:54:27.554578+0000","last_peered":"2022-03-21T13:54:27.554578+0000","last_clean":"2022-03-21T13:54:27.554578+0000","last_became_active":"2022-03-21T13:54:27.547518+0000","last_became_peered":"2022-03-21T13:54:27.547518+0000","last_unstale":"2022-03-21T13:54:27.554578+0000","last_undegraded":"2022-03-21T13:54:27.554578+0000","last_fullsized":"2022-03-21T13:54:27.554578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:51:03.595275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557697+0000","last_change":"2022-03-21T13:54:27.557697+0000","last_active":"2022-03-21T13:54:27.557697+0000","last_peered":"2022-03-21T13:54:27.557697+0000","last_clean":"2022-03-21T13:54:27.557697+0000","last_became_active":"2022-03-21T13:54:27.557422+0000","last_became_peered":"2022-03-21T13:54:27.557422+0000","last_unstale":"2022-03-21T13:54:27.557697+0000","last_undegraded":"2022-03-21T13:54:27.557697+0000","last_fullsized":"2022-03-21T13:54:27.557697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:19:10.850615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562316+0000","last_change":"2022-03-21T13:54:27.555304+0000","last_active":"2022-03-21T13:54:27.562316+0000","last_peered":"2022-03-21T13:54:27.562316+0000","last_clean":"2022-03-21T13:54:27.562316+0000","last_became_active":"2022-03-21T13:54:27.555046+0000","last_became_peered":"2022-03-21T13:54:27.555046+0000","last_unstale":"2022-03-21T13:54:27.562316+0000","last_undegraded":"2022-03-21T13:54:27.562316+0000","last_fullsized":"2022-03-21T13:54:27.562316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:20:53.409319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":58760,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8896,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362944,"statfs":{"total":96636764160,"available":96627654656,"internally_reserved":0,"allocated":253952,"data_stored":596467,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8388,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363452,"statfs":{"total":96636764160,"available":96628174848,"internally_reserved":0,"allocated":192512,"data_stored":67539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8972,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362868,"statfs":{"total":96636764160,"available":96627576832,"internally_reserved":0,"allocated":266240,"data_stored":603108,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8388,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363452,"statfs":{"total":96636764160,"available":96628174848,"internally_reserved":0,"allocated":192512,"data_stored":67539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":74180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":192512,"data_stored":67539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8464,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363376,"statfs":{"total":96636764160,"available":96628097024,"internally_reserved":0,"allocated":204800,"data_stored":74180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":74180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-03-21T13:54:33.217 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-03-21T13:54:33.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.355+0000 7f6c8f5ca700 1 Processor -- start 2022-03-21T13:54:33.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.355+0000 7f6c8f5ca700 1 -- start start 2022-03-21T13:54:33.366 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.356+0000 7f6c8f5ca700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6c880c45d0 0x7f6c880c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.367 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.356+0000 7f6c8f5ca700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6c8806ac50 0x7f6c880c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.367 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.356+0000 7f6c8f5ca700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8806b6d0 con 0x7f6c880c49a0 2022-03-21T13:54:33.367 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.356+0000 7f6c8f5ca700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c880c7300 con 0x7f6c880c45d0 2022-03-21T13:54:33.368 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.356+0000 7f6c8f5ca700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8806a6d0 con 0x7f6c8806ac50 2022-03-21T13:54:33.368 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.356+0000 7f6c8d366700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6c880c45d0 0x7f6c880c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.368 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.356+0000 7f6c8d366700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6c880c45d0 0x7f6c880c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56396/0 (socket says 172.21.15.160:56396) 2022-03-21T13:54:33.369 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.356+0000 7f6c8d366700 1 -- 172.21.15.160:0/3920661662 learned_addr learned my addr 172.21.15.160:0/3920661662 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:33.369 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8cb65700 1 --2- 172.21.15.160:0/3920661662 >> v2:172.21.15.171:3300/0 conn(0x7f6c8806ac50 0x7f6c880c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.370 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8d366700 1 -- 172.21.15.160:0/3920661662 >> v2:172.21.15.171:3300/0 conn(0x7f6c8806ac50 msgr2=0x7f6c880c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:33.370 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8d366700 1 --2- 172.21.15.160:0/3920661662 >> v2:172.21.15.171:3300/0 conn(0x7f6c8806ac50 0x7f6c880c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.370 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8d366700 1 -- 172.21.15.160:0/3920661662 >> v1:172.21.15.171:6789/0 conn(0x7f6c880c49a0 legacy=0x7f6c880c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.371 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8d366700 1 -- 172.21.15.160:0/3920661662 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8806b900 con 0x7f6c880c45d0 2022-03-21T13:54:33.371 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8d366700 1 --2- 172.21.15.160:0/3920661662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c880c45d0 0x7f6c880c58b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c88069fc0 tx=0x7f6c78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c7cd9c4bf8ea11 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:33.372 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c87fff700 1 -- 172.21.15.160:0/3920661662 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800e070 con 0x7f6c880c45d0 2022-03-21T13:54:33.372 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c87fff700 1 -- 172.21.15.160:0/3920661662 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7800ba50 con 0x7f6c880c45d0 2022-03-21T13:54:33.373 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c87fff700 1 -- 172.21.15.160:0/3920661662 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780092e0 con 0x7f6c880c45d0 2022-03-21T13:54:33.373 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/3920661662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c880c45d0 msgr2=0x7f6c880c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.373 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8f5ca700 1 --2- 172.21.15.160:0/3920661662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c880c45d0 0x7f6c880c58b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c88069fc0 tx=0x7f6c78009840 comp rx=0 tx=0).stop 2022-03-21T13:54:33.374 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/3920661662 shutdown_connections 2022-03-21T13:54:33.374 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8f5ca700 1 --2- 172.21.15.160:0/3920661662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c880c45d0 0x7f6c880c58b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.375 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8f5ca700 1 --2- 172.21.15.160:0/3920661662 >> v2:172.21.15.171:3300/0 conn(0x7f6c8806ac50 0x7f6c880c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.375 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.357+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/3920661662 >> 172.21.15.160:0/3920661662 conn(0x7f6c88068650 msgr2=0x7f6c880cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:33.376 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.358+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/3920661662 shutdown_connections 2022-03-21T13:54:33.376 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.358+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/3920661662 wait complete. 2022-03-21T13:54:33.377 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.359+0000 7f6c8f5ca700 1 Processor -- start 2022-03-21T13:54:33.377 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.359+0000 7f6c8f5ca700 1 -- start start 2022-03-21T13:54:33.377 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.359+0000 7f6c8f5ca700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c880c45d0 0x7f6c88168c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.359+0000 7f6c8f5ca700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c880c49a0 0x7f6c88165690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.359+0000 7f6c8f5ca700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c880aa230 0x7f6c880c08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.359+0000 7f6c8f5ca700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880ac630 con 0x7f6c880c45d0 2022-03-21T13:54:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.359+0000 7f6c8f5ca700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880a9530 con 0x7f6c880c49a0 2022-03-21T13:54:33.380 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.359+0000 7f6c8f5ca700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88164c80 con 0x7f6c880aa230 2022-03-21T13:54:33.380 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8d366700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c880c45d0 0x7f6c88168c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.380 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8d366700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c880c45d0 0x7f6c88168c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56402/0 (socket says 172.21.15.160:56402) 2022-03-21T13:54:33.381 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8d366700 1 -- 172.21.15.160:0/4224676212 learned_addr learned my addr 172.21.15.160:0/4224676212 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:33.381 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8cb65700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c880c49a0 0x7f6c88165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.382 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8db67700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c880aa230 0x7f6c880c08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.382 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8d366700 1 -- 172.21.15.160:0/4224676212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c880aa230 msgr2=0x7f6c880c08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.382 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8d366700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c880aa230 0x7f6c880c08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.383 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8d366700 1 -- 172.21.15.160:0/4224676212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c880c49a0 msgr2=0x7f6c88165690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.383 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8d366700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c880c49a0 0x7f6c88165690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.384 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8d366700 1 -- 172.21.15.160:0/4224676212 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c78009ae0 con 0x7f6c880c45d0 2022-03-21T13:54:33.384 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8d366700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c880c45d0 0x7f6c88168c60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009fd0 tx=0x7f6c78018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:33.385 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c857fa700 1 -- 172.21.15.160:0/4224676212 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780094e0 con 0x7f6c880c45d0 2022-03-21T13:54:33.385 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c857fa700 1 -- 172.21.15.160:0/4224676212 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c78003bf0 con 0x7f6c880c45d0 2022-03-21T13:54:33.386 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/4224676212 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c88165200 con 0x7f6c880c45d0 2022-03-21T13:54:33.386 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c857fa700 1 -- 172.21.15.160:0/4224676212 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c78007610 con 0x7f6c880c45d0 2022-03-21T13:54:33.386 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.360+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/4224676212 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c880a8f70 con 0x7f6c880c45d0 2022-03-21T13:54:33.387 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.361+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/4224676212 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8806fc00 con 0x7f6c880c45d0 2022-03-21T13:54:33.387 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.361+0000 7f6c857fa700 1 -- 172.21.15.160:0/4224676212 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f6c78007a40 con 0x7f6c880c45d0 2022-03-21T13:54:33.388 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.362+0000 7f6c857fa700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f6c68063ce0 0x7f6c68066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.388 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.362+0000 7f6c857fa700 1 -- 172.21.15.160:0/4224676212 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6c780824e0 con 0x7f6c880c45d0 2022-03-21T13:54:33.389 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.362+0000 7f6c8cb65700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f6c68063ce0 0x7f6c68066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.389 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.362+0000 7f6c8cb65700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f6c68063ce0 0x7f6c68066190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c880b1140 tx=0x7f6c7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:33.390 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.366+0000 7f6c857fa700 1 -- 172.21.15.160:0/4224676212 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f6c780510c0 con 0x7f6c880c45d0 2022-03-21T13:54:33.536 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.534+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/4224676212 --> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c881691a0 con 0x7f6c68063ce0 2022-03-21T13:54:33.543 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.542+0000 7f6c857fa700 1 -- 172.21.15.160:0/4224676212 <== mgr.4104 v2:172.21.15.160:6832/25205 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284940 (secure 0 0 0) 0x7f6c881691a0 con 0x7f6c68063ce0 2022-03-21T13:54:33.547 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:33.551 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/4224676212 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f6c68063ce0 msgr2=0x7f6c68066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f6c68063ce0 0x7f6c68066190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c880b1140 tx=0x7f6c7c008040 comp rx=0 tx=0).stop 2022-03-21T13:54:33.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/4224676212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c880c45d0 msgr2=0x7f6c88168c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c880c45d0 0x7f6c88168c60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009fd0 tx=0x7f6c78018000 comp rx=0 tx=0).stop 2022-03-21T13:54:33.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/4224676212 shutdown_connections 2022-03-21T13:54:33.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f6c68063ce0 0x7f6c68066190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.554 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c880aa230 0x7f6c880c08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.554 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c880c45d0 0x7f6c88168c60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 --2- 172.21.15.160:0/4224676212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c880c49a0 0x7f6c88165690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/4224676212 >> 172.21.15.160:0/4224676212 conn(0x7f6c88068650 msgr2=0x7f6c880c1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:33.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/4224676212 shutdown_connections 2022-03-21T13:54:33.556 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.545+0000 7f6c8f5ca700 1 -- 172.21.15.160:0/4224676212 wait complete. 2022-03-21T13:54:33.556 INFO:teuthology.orchestra.run.smithi160.stderr:dumped all 2022-03-21T13:54:33.559 INFO:teuthology.orchestra.run.smithi160.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2022-03-21T13:54:33.458946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68360,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":66624,"kb_avail":754906360,"statfs":{"total":773094113280,"available":773024112640,"internally_reserved":0,"allocated":1712128,"data_stored":1624732,"data_compressed":58760,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":68222976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.297747"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562599+0000","last_change":"2022-03-21T13:54:27.560800+0000","last_active":"2022-03-21T13:54:27.562599+0000","last_peered":"2022-03-21T13:54:27.562599+0000","last_clean":"2022-03-21T13:54:27.562599+0000","last_became_active":"2022-03-21T13:54:27.560524+0000","last_became_peered":"2022-03-21T13:54:27.560524+0000","last_unstale":"2022-03-21T13:54:27.562599+0000","last_undegraded":"2022-03-21T13:54:27.562599+0000","last_fullsized":"2022-03-21T13:54:27.562599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:29:18.469060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.550598+0000","last_change":"2022-03-21T13:54:27.546054+0000","last_active":"2022-03-21T13:54:27.550598+0000","last_peered":"2022-03-21T13:54:27.550598+0000","last_clean":"2022-03-21T13:54:27.550598+0000","last_became_active":"2022-03-21T13:54:27.545740+0000","last_became_peered":"2022-03-21T13:54:27.545740+0000","last_unstale":"2022-03-21T13:54:27.550598+0000","last_undegraded":"2022-03-21T13:54:27.550598+0000","last_fullsized":"2022-03-21T13:54:27.550598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:26:02.461346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561382+0000","last_change":"2022-03-21T13:54:27.558255+0000","last_active":"2022-03-21T13:54:27.561382+0000","last_peered":"2022-03-21T13:54:27.561382+0000","last_clean":"2022-03-21T13:54:27.561382+0000","last_became_active":"2022-03-21T13:54:27.558022+0000","last_became_peered":"2022-03-21T13:54:27.558022+0000","last_unstale":"2022-03-21T13:54:27.561382+0000","last_undegraded":"2022-03-21T13:54:27.561382+0000","last_fullsized":"2022-03-21T13:54:27.561382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:13:18.709698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557489+0000","last_change":"2022-03-21T13:54:27.557489+0000","last_active":"2022-03-21T13:54:27.557489+0000","last_peered":"2022-03-21T13:54:27.557489+0000","last_clean":"2022-03-21T13:54:27.557489+0000","last_became_active":"2022-03-21T13:54:27.557158+0000","last_became_peered":"2022-03-21T13:54:27.557158+0000","last_unstale":"2022-03-21T13:54:27.557489+0000","last_undegraded":"2022-03-21T13:54:27.557489+0000","last_fullsized":"2022-03-21T13:54:27.557489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:40:54.983646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564403+0000","last_change":"2022-03-21T13:54:27.564403+0000","last_active":"2022-03-21T13:54:27.564403+0000","last_peered":"2022-03-21T13:54:27.564403+0000","last_clean":"2022-03-21T13:54:27.564403+0000","last_became_active":"2022-03-21T13:54:27.564206+0000","last_became_peered":"2022-03-21T13:54:27.564206+0000","last_unstale":"2022-03-21T13:54:27.564403+0000","last_undegraded":"2022-03-21T13:54:27.564403+0000","last_fullsized":"2022-03-21T13:54:27.564403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:59:14.326123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561303+0000","last_change":"2022-03-21T13:54:27.557180+0000","last_active":"2022-03-21T13:54:27.561303+0000","last_peered":"2022-03-21T13:54:27.561303+0000","last_clean":"2022-03-21T13:54:27.561303+0000","last_became_active":"2022-03-21T13:54:27.556920+0000","last_became_peered":"2022-03-21T13:54:27.556920+0000","last_unstale":"2022-03-21T13:54:27.561303+0000","last_undegraded":"2022-03-21T13:54:27.561303+0000","last_fullsized":"2022-03-21T13:54:27.561303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:08:18.086954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.565259+0000","last_change":"2022-03-21T13:54:27.565259+0000","last_active":"2022-03-21T13:54:27.565259+0000","last_peered":"2022-03-21T13:54:27.565259+0000","last_clean":"2022-03-21T13:54:27.565259+0000","last_became_active":"2022-03-21T13:54:27.564920+0000","last_became_peered":"2022-03-21T13:54:27.564920+0000","last_unstale":"2022-03-21T13:54:27.565259+0000","last_undegraded":"2022-03-21T13:54:27.565259+0000","last_fullsized":"2022-03-21T13:54:27.565259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:32:42.928977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556183+0000","last_change":"2022-03-21T13:54:27.553677+0000","last_active":"2022-03-21T13:54:27.556183+0000","last_peered":"2022-03-21T13:54:27.556183+0000","last_clean":"2022-03-21T13:54:27.556183+0000","last_became_active":"2022-03-21T13:54:27.553385+0000","last_became_peered":"2022-03-21T13:54:27.553385+0000","last_unstale":"2022-03-21T13:54:27.556183+0000","last_undegraded":"2022-03-21T13:54:27.556183+0000","last_fullsized":"2022-03-21T13:54:27.556183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:11:07.645677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.558348+0000","last_change":"2022-03-21T13:54:27.558348+0000","last_active":"2022-03-21T13:54:27.558348+0000","last_peered":"2022-03-21T13:54:27.558348+0000","last_clean":"2022-03-21T13:54:27.558348+0000","last_became_active":"2022-03-21T13:54:27.557809+0000","last_became_peered":"2022-03-21T13:54:27.557809+0000","last_unstale":"2022-03-21T13:54:27.558348+0000","last_undegraded":"2022-03-21T13:54:27.558348+0000","last_fullsized":"2022-03-21T13:54:27.558348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:46:38.130496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561257+0000","last_change":"2022-03-21T13:54:27.557849+0000","last_active":"2022-03-21T13:54:27.561257+0000","last_peered":"2022-03-21T13:54:27.561257+0000","last_clean":"2022-03-21T13:54:27.561257+0000","last_became_active":"2022-03-21T13:54:27.557598+0000","last_became_peered":"2022-03-21T13:54:27.557598+0000","last_unstale":"2022-03-21T13:54:27.561257+0000","last_undegraded":"2022-03-21T13:54:27.561257+0000","last_fullsized":"2022-03-21T13:54:27.561257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:02:12.450734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552732+0000","last_change":"2022-03-21T13:54:27.546503+0000","last_active":"2022-03-21T13:54:27.552732+0000","last_peered":"2022-03-21T13:54:27.552732+0000","last_clean":"2022-03-21T13:54:27.552732+0000","last_became_active":"2022-03-21T13:54:27.546206+0000","last_became_peered":"2022-03-21T13:54:27.546206+0000","last_unstale":"2022-03-21T13:54:27.552732+0000","last_undegraded":"2022-03-21T13:54:27.552732+0000","last_fullsized":"2022-03-21T13:54:27.552732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:30:57.355670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561846+0000","last_change":"2022-03-21T13:54:27.556507+0000","last_active":"2022-03-21T13:54:27.561846+0000","last_peered":"2022-03-21T13:54:27.561846+0000","last_clean":"2022-03-21T13:54:27.561846+0000","last_became_active":"2022-03-21T13:54:27.556230+0000","last_became_peered":"2022-03-21T13:54:27.556230+0000","last_unstale":"2022-03-21T13:54:27.561846+0000","last_undegraded":"2022-03-21T13:54:27.561846+0000","last_fullsized":"2022-03-21T13:54:27.561846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:34:35.624406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562378+0000","last_change":"2022-03-21T13:54:27.559880+0000","last_active":"2022-03-21T13:54:27.562378+0000","last_peered":"2022-03-21T13:54:27.562378+0000","last_clean":"2022-03-21T13:54:27.562378+0000","last_became_active":"2022-03-21T13:54:27.559587+0000","last_became_peered":"2022-03-21T13:54:27.559587+0000","last_unstale":"2022-03-21T13:54:27.562378+0000","last_undegraded":"2022-03-21T13:54:27.562378+0000","last_fullsized":"2022-03-21T13:54:27.562378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:25:15.705881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561513+0000","last_change":"2022-03-21T13:54:27.558473+0000","last_active":"2022-03-21T13:54:27.561513+0000","last_peered":"2022-03-21T13:54:27.561513+0000","last_clean":"2022-03-21T13:54:27.561513+0000","last_became_active":"2022-03-21T13:54:27.557800+0000","last_became_peered":"2022-03-21T13:54:27.557800+0000","last_unstale":"2022-03-21T13:54:27.561513+0000","last_undegraded":"2022-03-21T13:54:27.561513+0000","last_fullsized":"2022-03-21T13:54:27.561513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:43:47.336190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.565260+0000","last_change":"2022-03-21T13:54:27.565260+0000","last_active":"2022-03-21T13:54:27.565260+0000","last_peered":"2022-03-21T13:54:27.565260+0000","last_clean":"2022-03-21T13:54:27.565260+0000","last_became_active":"2022-03-21T13:54:27.564955+0000","last_became_peered":"2022-03-21T13:54:27.564955+0000","last_unstale":"2022-03-21T13:54:27.565260+0000","last_undegraded":"2022-03-21T13:54:27.565260+0000","last_fullsized":"2022-03-21T13:54:27.565260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T13:54:36.332945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561411+0000","last_change":"2022-03-21T13:54:27.558826+0000","last_active":"2022-03-21T13:54:27.561411+0000","last_peered":"2022-03-21T13:54:27.561411+0000","last_clean":"2022-03-21T13:54:27.561411+0000","last_became_active":"2022-03-21T13:54:27.558001+0000","last_became_peered":"2022-03-21T13:54:27.558001+0000","last_unstale":"2022-03-21T13:54:27.561411+0000","last_undegraded":"2022-03-21T13:54:27.561411+0000","last_fullsized":"2022-03-21T13:54:27.561411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:09:43.452276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556666+0000","last_change":"2022-03-21T13:54:27.556666+0000","last_active":"2022-03-21T13:54:27.556666+0000","last_peered":"2022-03-21T13:54:27.556666+0000","last_clean":"2022-03-21T13:54:27.556666+0000","last_became_active":"2022-03-21T13:54:27.556355+0000","last_became_peered":"2022-03-21T13:54:27.556355+0000","last_unstale":"2022-03-21T13:54:27.556666+0000","last_undegraded":"2022-03-21T13:54:27.556666+0000","last_fullsized":"2022-03-21T13:54:27.556666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:50:08.704449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561401+0000","last_change":"2022-03-21T13:54:27.558635+0000","last_active":"2022-03-21T13:54:27.561401+0000","last_peered":"2022-03-21T13:54:27.561401+0000","last_clean":"2022-03-21T13:54:27.561401+0000","last_became_active":"2022-03-21T13:54:27.558320+0000","last_became_peered":"2022-03-21T13:54:27.558320+0000","last_unstale":"2022-03-21T13:54:27.561401+0000","last_undegraded":"2022-03-21T13:54:27.561401+0000","last_fullsized":"2022-03-21T13:54:27.561401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:14:17.971078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562412+0000","last_change":"2022-03-21T13:54:27.557412+0000","last_active":"2022-03-21T13:54:27.562412+0000","last_peered":"2022-03-21T13:54:27.562412+0000","last_clean":"2022-03-21T13:54:27.562412+0000","last_became_active":"2022-03-21T13:54:27.557140+0000","last_became_peered":"2022-03-21T13:54:27.557140+0000","last_unstale":"2022-03-21T13:54:27.562412+0000","last_undegraded":"2022-03-21T13:54:27.562412+0000","last_fullsized":"2022-03-21T13:54:27.562412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:14:32.888607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556264+0000","last_change":"2022-03-21T13:54:27.553441+0000","last_active":"2022-03-21T13:54:27.556264+0000","last_peered":"2022-03-21T13:54:27.556264+0000","last_clean":"2022-03-21T13:54:27.556264+0000","last_became_active":"2022-03-21T13:54:27.553027+0000","last_became_peered":"2022-03-21T13:54:27.553027+0000","last_unstale":"2022-03-21T13:54:27.556264+0000","last_undegraded":"2022-03-21T13:54:27.556264+0000","last_fullsized":"2022-03-21T13:54:27.556264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:18:30.624463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563794+0000","last_change":"2022-03-21T13:54:27.563794+0000","last_active":"2022-03-21T13:54:27.563794+0000","last_peered":"2022-03-21T13:54:27.563794+0000","last_clean":"2022-03-21T13:54:27.563794+0000","last_became_active":"2022-03-21T13:54:27.563545+0000","last_became_peered":"2022-03-21T13:54:27.563545+0000","last_unstale":"2022-03-21T13:54:27.563794+0000","last_undegraded":"2022-03-21T13:54:27.563794+0000","last_fullsized":"2022-03-21T13:54:27.563794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:50:55.275326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553387+0000","last_change":"2022-03-21T13:54:27.553387+0000","last_active":"2022-03-21T13:54:27.553387+0000","last_peered":"2022-03-21T13:54:27.553387+0000","last_clean":"2022-03-21T13:54:27.553387+0000","last_became_active":"2022-03-21T13:54:27.553153+0000","last_became_peered":"2022-03-21T13:54:27.553153+0000","last_unstale":"2022-03-21T13:54:27.553387+0000","last_undegraded":"2022-03-21T13:54:27.553387+0000","last_fullsized":"2022-03-21T13:54:27.553387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:50:23.006803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563751+0000","last_change":"2022-03-21T13:54:27.563751+0000","last_active":"2022-03-21T13:54:27.563751+0000","last_peered":"2022-03-21T13:54:27.563751+0000","last_clean":"2022-03-21T13:54:27.563751+0000","last_became_active":"2022-03-21T13:54:27.563500+0000","last_became_peered":"2022-03-21T13:54:27.563500+0000","last_unstale":"2022-03-21T13:54:27.563751+0000","last_undegraded":"2022-03-21T13:54:27.563751+0000","last_fullsized":"2022-03-21T13:54:27.563751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:56:25.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.558999+0000","last_change":"2022-03-21T13:54:27.558999+0000","last_active":"2022-03-21T13:54:27.558999+0000","last_peered":"2022-03-21T13:54:27.558999+0000","last_clean":"2022-03-21T13:54:27.558999+0000","last_became_active":"2022-03-21T13:54:27.558681+0000","last_became_peered":"2022-03-21T13:54:27.558681+0000","last_unstale":"2022-03-21T13:54:27.558999+0000","last_undegraded":"2022-03-21T13:54:27.558999+0000","last_fullsized":"2022-03-21T13:54:27.558999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:42:26.014896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552966+0000","last_change":"2022-03-21T13:54:27.550096+0000","last_active":"2022-03-21T13:54:27.552966+0000","last_peered":"2022-03-21T13:54:27.552966+0000","last_clean":"2022-03-21T13:54:27.552966+0000","last_became_active":"2022-03-21T13:54:27.549821+0000","last_became_peered":"2022-03-21T13:54:27.549821+0000","last_unstale":"2022-03-21T13:54:27.552966+0000","last_undegraded":"2022-03-21T13:54:27.552966+0000","last_fullsized":"2022-03-21T13:54:27.552966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:32:24.498709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563579+0000","last_change":"2022-03-21T13:54:27.561032+0000","last_active":"2022-03-21T13:54:27.563579+0000","last_peered":"2022-03-21T13:54:27.563579+0000","last_clean":"2022-03-21T13:54:27.563579+0000","last_became_active":"2022-03-21T13:54:27.560494+0000","last_became_peered":"2022-03-21T13:54:27.560494+0000","last_unstale":"2022-03-21T13:54:27.563579+0000","last_undegraded":"2022-03-21T13:54:27.563579+0000","last_fullsized":"2022-03-21T13:54:27.563579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:25:56.396980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561291+0000","last_change":"2022-03-21T13:54:27.558917+0000","last_active":"2022-03-21T13:54:27.561291+0000","last_peered":"2022-03-21T13:54:27.561291+0000","last_clean":"2022-03-21T13:54:27.561291+0000","last_became_active":"2022-03-21T13:54:27.556966+0000","last_became_peered":"2022-03-21T13:54:27.556966+0000","last_unstale":"2022-03-21T13:54:27.561291+0000","last_undegraded":"2022-03-21T13:54:27.561291+0000","last_fullsized":"2022-03-21T13:54:27.561291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:43:43.072254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544651+0000","last_change":"2022-03-21T13:54:27.180549+0000","last_active":"2022-03-21T13:54:27.544651+0000","last_peered":"2022-03-21T13:54:27.544651+0000","last_clean":"2022-03-21T13:54:27.544651+0000","last_became_active":"2022-03-21T13:54:27.178977+0000","last_became_peered":"2022-03-21T13:54:27.178977+0000","last_unstale":"2022-03-21T13:54:27.544651+0000","last_undegraded":"2022-03-21T13:54:27.544651+0000","last_fullsized":"2022-03-21T13:54:27.544651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:11:42.262563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546371+0000","last_change":"2022-03-21T13:54:27.546371+0000","last_active":"2022-03-21T13:54:27.546371+0000","last_peered":"2022-03-21T13:54:27.546371+0000","last_clean":"2022-03-21T13:54:27.546371+0000","last_became_active":"2022-03-21T13:54:27.546107+0000","last_became_peered":"2022-03-21T13:54:27.546107+0000","last_unstale":"2022-03-21T13:54:27.546371+0000","last_undegraded":"2022-03-21T13:54:27.546371+0000","last_fullsized":"2022-03-21T13:54:27.546371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:03:31.464752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546952+0000","last_change":"2022-03-21T13:54:27.184281+0000","last_active":"2022-03-21T13:54:27.546952+0000","last_peered":"2022-03-21T13:54:27.546952+0000","last_clean":"2022-03-21T13:54:27.546952+0000","last_became_active":"2022-03-21T13:54:27.183982+0000","last_became_peered":"2022-03-21T13:54:27.183982+0000","last_unstale":"2022-03-21T13:54:27.546952+0000","last_undegraded":"2022-03-21T13:54:27.546952+0000","last_fullsized":"2022-03-21T13:54:27.546952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:05:10.462607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561606+0000","last_change":"2022-03-21T13:54:27.561606+0000","last_active":"2022-03-21T13:54:27.561606+0000","last_peered":"2022-03-21T13:54:27.561606+0000","last_clean":"2022-03-21T13:54:27.561606+0000","last_became_active":"2022-03-21T13:54:27.557656+0000","last_became_peered":"2022-03-21T13:54:27.557656+0000","last_unstale":"2022-03-21T13:54:27.561606+0000","last_undegraded":"2022-03-21T13:54:27.561606+0000","last_fullsized":"2022-03-21T13:54:27.561606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:18:31.529342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.184503+0000","last_change":"2022-03-21T13:54:27.181800+0000","last_active":"2022-03-21T13:54:27.184503+0000","last_peered":"2022-03-21T13:54:27.184503+0000","last_clean":"2022-03-21T13:54:27.184503+0000","last_became_active":"2022-03-21T13:54:27.181378+0000","last_became_peered":"2022-03-21T13:54:27.181378+0000","last_unstale":"2022-03-21T13:54:27.184503+0000","last_undegraded":"2022-03-21T13:54:27.184503+0000","last_fullsized":"2022-03-21T13:54:27.184503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T13:59:13.837451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.547987+0000","last_change":"2022-03-21T13:54:27.547987+0000","last_active":"2022-03-21T13:54:27.547987+0000","last_peered":"2022-03-21T13:54:27.547987+0000","last_clean":"2022-03-21T13:54:27.547987+0000","last_became_active":"2022-03-21T13:54:27.547719+0000","last_became_peered":"2022-03-21T13:54:27.547719+0000","last_unstale":"2022-03-21T13:54:27.547987+0000","last_undegraded":"2022-03-21T13:54:27.547987+0000","last_fullsized":"2022-03-21T13:54:27.547987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:20:42.860191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.185927+0000","last_change":"2022-03-21T13:54:27.177649+0000","last_active":"2022-03-21T13:54:27.185927+0000","last_peered":"2022-03-21T13:54:27.185927+0000","last_clean":"2022-03-21T13:54:27.185927+0000","last_became_active":"2022-03-21T13:54:27.176925+0000","last_became_peered":"2022-03-21T13:54:27.176925+0000","last_unstale":"2022-03-21T13:54:27.185927+0000","last_undegraded":"2022-03-21T13:54:27.185927+0000","last_fullsized":"2022-03-21T13:54:27.185927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:05:31.974802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553129+0000","last_change":"2022-03-21T13:54:27.553129+0000","last_active":"2022-03-21T13:54:27.553129+0000","last_peered":"2022-03-21T13:54:27.553129+0000","last_clean":"2022-03-21T13:54:27.553129+0000","last_became_active":"2022-03-21T13:54:27.552857+0000","last_became_peered":"2022-03-21T13:54:27.552857+0000","last_unstale":"2022-03-21T13:54:27.553129+0000","last_undegraded":"2022-03-21T13:54:27.553129+0000","last_fullsized":"2022-03-21T13:54:27.553129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:49:43.458618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.540230+0000","last_change":"2022-03-21T13:54:27.176726+0000","last_active":"2022-03-21T13:54:27.540230+0000","last_peered":"2022-03-21T13:54:27.540230+0000","last_clean":"2022-03-21T13:54:27.540230+0000","last_became_active":"2022-03-21T13:54:27.176464+0000","last_became_peered":"2022-03-21T13:54:27.176464+0000","last_unstale":"2022-03-21T13:54:27.540230+0000","last_undegraded":"2022-03-21T13:54:27.540230+0000","last_fullsized":"2022-03-21T13:54:27.540230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:01:07.573227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.555953+0000","last_change":"2022-03-21T13:54:27.555953+0000","last_active":"2022-03-21T13:54:27.555953+0000","last_peered":"2022-03-21T13:54:27.555953+0000","last_clean":"2022-03-21T13:54:27.555953+0000","last_became_active":"2022-03-21T13:54:27.555697+0000","last_became_peered":"2022-03-21T13:54:27.555697+0000","last_unstale":"2022-03-21T13:54:27.555953+0000","last_undegraded":"2022-03-21T13:54:27.555953+0000","last_fullsized":"2022-03-21T13:54:27.555953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:04:28.623659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.188297+0000","last_change":"2022-03-21T13:54:27.181859+0000","last_active":"2022-03-21T13:54:27.188297+0000","last_peered":"2022-03-21T13:54:27.188297+0000","last_clean":"2022-03-21T13:54:27.188297+0000","last_became_active":"2022-03-21T13:54:27.181629+0000","last_became_peered":"2022-03-21T13:54:27.181629+0000","last_unstale":"2022-03-21T13:54:27.188297+0000","last_undegraded":"2022-03-21T13:54:27.188297+0000","last_fullsized":"2022-03-21T13:54:27.188297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:24:23.689696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553010+0000","last_change":"2022-03-21T13:54:27.549413+0000","last_active":"2022-03-21T13:54:27.553010+0000","last_peered":"2022-03-21T13:54:27.553010+0000","last_clean":"2022-03-21T13:54:27.553010+0000","last_became_active":"2022-03-21T13:54:27.549162+0000","last_became_peered":"2022-03-21T13:54:27.549162+0000","last_unstale":"2022-03-21T13:54:27.553010+0000","last_undegraded":"2022-03-21T13:54:27.553010+0000","last_fullsized":"2022-03-21T13:54:27.553010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:06:56.454596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544701+0000","last_change":"2022-03-21T13:54:27.181484+0000","last_active":"2022-03-21T13:54:27.544701+0000","last_peered":"2022-03-21T13:54:27.544701+0000","last_clean":"2022-03-21T13:54:27.544701+0000","last_became_active":"2022-03-21T13:54:27.181191+0000","last_became_peered":"2022-03-21T13:54:27.181191+0000","last_unstale":"2022-03-21T13:54:27.544701+0000","last_undegraded":"2022-03-21T13:54:27.544701+0000","last_fullsized":"2022-03-21T13:54:27.544701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:10:19.939317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554603+0000","last_change":"2022-03-21T13:54:27.547927+0000","last_active":"2022-03-21T13:54:27.554603+0000","last_peered":"2022-03-21T13:54:27.554603+0000","last_clean":"2022-03-21T13:54:27.554603+0000","last_became_active":"2022-03-21T13:54:27.547605+0000","last_became_peered":"2022-03-21T13:54:27.547605+0000","last_unstale":"2022-03-21T13:54:27.554603+0000","last_undegraded":"2022-03-21T13:54:27.554603+0000","last_fullsized":"2022-03-21T13:54:27.554603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:57:24.920256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.191096+0000","last_change":"2022-03-21T13:54:27.183437+0000","last_active":"2022-03-21T13:54:27.191096+0000","last_peered":"2022-03-21T13:54:27.191096+0000","last_clean":"2022-03-21T13:54:27.191096+0000","last_became_active":"2022-03-21T13:54:27.183118+0000","last_became_peered":"2022-03-21T13:54:27.183118+0000","last_unstale":"2022-03-21T13:54:27.191096+0000","last_undegraded":"2022-03-21T13:54:27.191096+0000","last_fullsized":"2022-03-21T13:54:27.191096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:46:16.301549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553692+0000","last_change":"2022-03-21T13:54:27.553692+0000","last_active":"2022-03-21T13:54:27.553692+0000","last_peered":"2022-03-21T13:54:27.553692+0000","last_clean":"2022-03-21T13:54:27.553692+0000","last_became_active":"2022-03-21T13:54:27.553419+0000","last_became_peered":"2022-03-21T13:54:27.553419+0000","last_unstale":"2022-03-21T13:54:27.553692+0000","last_undegraded":"2022-03-21T13:54:27.553692+0000","last_fullsized":"2022-03-21T13:54:27.553692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:47:02.533721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.185952+0000","last_change":"2022-03-21T13:54:27.179452+0000","last_active":"2022-03-21T13:54:27.185952+0000","last_peered":"2022-03-21T13:54:27.185952+0000","last_clean":"2022-03-21T13:54:27.185952+0000","last_became_active":"2022-03-21T13:54:27.177655+0000","last_became_peered":"2022-03-21T13:54:27.177655+0000","last_unstale":"2022-03-21T13:54:27.185952+0000","last_undegraded":"2022-03-21T13:54:27.185952+0000","last_fullsized":"2022-03-21T13:54:27.185952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:42:43.049495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561270+0000","last_change":"2022-03-21T13:54:27.557989+0000","last_active":"2022-03-21T13:54:27.561270+0000","last_peered":"2022-03-21T13:54:27.561270+0000","last_clean":"2022-03-21T13:54:27.561270+0000","last_became_active":"2022-03-21T13:54:27.557346+0000","last_became_peered":"2022-03-21T13:54:27.557346+0000","last_unstale":"2022-03-21T13:54:27.561270+0000","last_undegraded":"2022-03-21T13:54:27.561270+0000","last_fullsized":"2022-03-21T13:54:27.561270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:54:09.949225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.180492+0000","last_change":"2022-03-21T13:54:27.177423+0000","last_active":"2022-03-21T13:54:27.180492+0000","last_peered":"2022-03-21T13:54:27.180492+0000","last_clean":"2022-03-21T13:54:27.180492+0000","last_became_active":"2022-03-21T13:54:27.177050+0000","last_became_peered":"2022-03-21T13:54:27.177050+0000","last_unstale":"2022-03-21T13:54:27.180492+0000","last_undegraded":"2022-03-21T13:54:27.180492+0000","last_fullsized":"2022-03-21T13:54:27.180492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:03:05.301157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557999+0000","last_change":"2022-03-21T13:54:27.557999+0000","last_active":"2022-03-21T13:54:27.557999+0000","last_peered":"2022-03-21T13:54:27.557999+0000","last_clean":"2022-03-21T13:54:27.557999+0000","last_became_active":"2022-03-21T13:54:27.557001+0000","last_became_peered":"2022-03-21T13:54:27.557001+0000","last_unstale":"2022-03-21T13:54:27.557999+0000","last_undegraded":"2022-03-21T13:54:27.557999+0000","last_fullsized":"2022-03-21T13:54:27.557999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:44:28.857826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.188282+0000","last_change":"2022-03-21T13:54:27.184135+0000","last_active":"2022-03-21T13:54:27.188282+0000","last_peered":"2022-03-21T13:54:27.188282+0000","last_clean":"2022-03-21T13:54:27.188282+0000","last_became_active":"2022-03-21T13:54:27.183892+0000","last_became_peered":"2022-03-21T13:54:27.183892+0000","last_unstale":"2022-03-21T13:54:27.188282+0000","last_undegraded":"2022-03-21T13:54:27.188282+0000","last_fullsized":"2022-03-21T13:54:27.188282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:44:30.017340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559857+0000","last_change":"2022-03-21T13:54:27.559857+0000","last_active":"2022-03-21T13:54:27.559857+0000","last_peered":"2022-03-21T13:54:27.559857+0000","last_clean":"2022-03-21T13:54:27.559857+0000","last_became_active":"2022-03-21T13:54:27.559336+0000","last_became_peered":"2022-03-21T13:54:27.559336+0000","last_unstale":"2022-03-21T13:54:27.559857+0000","last_undegraded":"2022-03-21T13:54:27.559857+0000","last_fullsized":"2022-03-21T13:54:27.559857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:43:12.014350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.180459+0000","last_change":"2022-03-21T13:54:27.178818+0000","last_active":"2022-03-21T13:54:27.180459+0000","last_peered":"2022-03-21T13:54:27.180459+0000","last_clean":"2022-03-21T13:54:27.180459+0000","last_became_active":"2022-03-21T13:54:27.178542+0000","last_became_peered":"2022-03-21T13:54:27.178542+0000","last_unstale":"2022-03-21T13:54:27.180459+0000","last_undegraded":"2022-03-21T13:54:27.180459+0000","last_fullsized":"2022-03-21T13:54:27.180459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:45:39.568015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.560603+0000","last_change":"2022-03-21T13:54:27.555377+0000","last_active":"2022-03-21T13:54:27.560603+0000","last_peered":"2022-03-21T13:54:27.560603+0000","last_clean":"2022-03-21T13:54:27.560603+0000","last_became_active":"2022-03-21T13:54:27.555080+0000","last_became_peered":"2022-03-21T13:54:27.555080+0000","last_unstale":"2022-03-21T13:54:27.560603+0000","last_undegraded":"2022-03-21T13:54:27.560603+0000","last_fullsized":"2022-03-21T13:54:27.560603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:16:31.684909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.179623+0000","last_change":"2022-03-21T13:54:27.175755+0000","last_active":"2022-03-21T13:54:27.179623+0000","last_peered":"2022-03-21T13:54:27.179623+0000","last_clean":"2022-03-21T13:54:27.179623+0000","last_became_active":"2022-03-21T13:54:27.175442+0000","last_became_peered":"2022-03-21T13:54:27.175442+0000","last_unstale":"2022-03-21T13:54:27.179623+0000","last_undegraded":"2022-03-21T13:54:27.179623+0000","last_fullsized":"2022-03-21T13:54:27.179623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:21:41.935690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559410+0000","last_change":"2022-03-21T13:54:27.555167+0000","last_active":"2022-03-21T13:54:27.559410+0000","last_peered":"2022-03-21T13:54:27.559410+0000","last_clean":"2022-03-21T13:54:27.559410+0000","last_became_active":"2022-03-21T13:54:27.554856+0000","last_became_peered":"2022-03-21T13:54:27.554856+0000","last_unstale":"2022-03-21T13:54:27.559410+0000","last_undegraded":"2022-03-21T13:54:27.559410+0000","last_fullsized":"2022-03-21T13:54:27.559410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:57:23.684151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.179729+0000","last_change":"2022-03-21T13:54:27.176740+0000","last_active":"2022-03-21T13:54:27.179729+0000","last_peered":"2022-03-21T13:54:27.179729+0000","last_clean":"2022-03-21T13:54:27.179729+0000","last_became_active":"2022-03-21T13:54:27.176438+0000","last_became_peered":"2022-03-21T13:54:27.176438+0000","last_unstale":"2022-03-21T13:54:27.179729+0000","last_undegraded":"2022-03-21T13:54:27.179729+0000","last_fullsized":"2022-03-21T13:54:27.179729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:30:43.910676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546515+0000","last_change":"2022-03-21T13:54:27.546515+0000","last_active":"2022-03-21T13:54:27.546515+0000","last_peered":"2022-03-21T13:54:27.546515+0000","last_clean":"2022-03-21T13:54:27.546515+0000","last_became_active":"2022-03-21T13:54:27.546277+0000","last_became_peered":"2022-03-21T13:54:27.546277+0000","last_unstale":"2022-03-21T13:54:27.546515+0000","last_undegraded":"2022-03-21T13:54:27.546515+0000","last_fullsized":"2022-03-21T13:54:27.546515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:55:14.541373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538652+0000","last_change":"2022-03-21T13:54:27.173718+0000","last_active":"2022-03-21T13:54:27.538652+0000","last_peered":"2022-03-21T13:54:27.538652+0000","last_clean":"2022-03-21T13:54:27.538652+0000","last_became_active":"2022-03-21T13:54:27.173384+0000","last_became_peered":"2022-03-21T13:54:27.173384+0000","last_unstale":"2022-03-21T13:54:27.538652+0000","last_undegraded":"2022-03-21T13:54:27.538652+0000","last_fullsized":"2022-03-21T13:54:27.538652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:27:30.485761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553332+0000","last_change":"2022-03-21T13:54:27.553332+0000","last_active":"2022-03-21T13:54:27.553332+0000","last_peered":"2022-03-21T13:54:27.553332+0000","last_clean":"2022-03-21T13:54:27.553332+0000","last_became_active":"2022-03-21T13:54:27.553052+0000","last_became_peered":"2022-03-21T13:54:27.553052+0000","last_unstale":"2022-03-21T13:54:27.553332+0000","last_undegraded":"2022-03-21T13:54:27.553332+0000","last_fullsized":"2022-03-21T13:54:27.553332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:04:17.341255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.183779+0000","last_change":"2022-03-21T13:54:27.181423+0000","last_active":"2022-03-21T13:54:27.183779+0000","last_peered":"2022-03-21T13:54:27.183779+0000","last_clean":"2022-03-21T13:54:27.183779+0000","last_became_active":"2022-03-21T13:54:27.181127+0000","last_became_peered":"2022-03-21T13:54:27.181127+0000","last_unstale":"2022-03-21T13:54:27.183779+0000","last_undegraded":"2022-03-21T13:54:27.183779+0000","last_fullsized":"2022-03-21T13:54:27.183779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:17:46.749032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556245+0000","last_change":"2022-03-21T13:54:27.553277+0000","last_active":"2022-03-21T13:54:27.556245+0000","last_peered":"2022-03-21T13:54:27.556245+0000","last_clean":"2022-03-21T13:54:27.556245+0000","last_became_active":"2022-03-21T13:54:27.552711+0000","last_became_peered":"2022-03-21T13:54:27.552711+0000","last_unstale":"2022-03-21T13:54:27.556245+0000","last_undegraded":"2022-03-21T13:54:27.556245+0000","last_fullsized":"2022-03-21T13:54:27.556245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:18:24.656738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.191227+0000","last_change":"2022-03-21T13:54:27.188996+0000","last_active":"2022-03-21T13:54:27.191227+0000","last_peered":"2022-03-21T13:54:27.191227+0000","last_clean":"2022-03-21T13:54:27.191227+0000","last_became_active":"2022-03-21T13:54:27.188638+0000","last_became_peered":"2022-03-21T13:54:27.188638+0000","last_unstale":"2022-03-21T13:54:27.191227+0000","last_undegraded":"2022-03-21T13:54:27.191227+0000","last_fullsized":"2022-03-21T13:54:27.191227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:49:19.960076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561350+0000","last_change":"2022-03-21T13:54:27.557724+0000","last_active":"2022-03-21T13:54:27.561350+0000","last_peered":"2022-03-21T13:54:27.561350+0000","last_clean":"2022-03-21T13:54:27.561350+0000","last_became_active":"2022-03-21T13:54:27.557422+0000","last_became_peered":"2022-03-21T13:54:27.557422+0000","last_unstale":"2022-03-21T13:54:27.561350+0000","last_undegraded":"2022-03-21T13:54:27.561350+0000","last_fullsized":"2022-03-21T13:54:27.561350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:34:17.342191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544789+0000","last_change":"2022-03-21T13:54:27.175632+0000","last_active":"2022-03-21T13:54:27.544789+0000","last_peered":"2022-03-21T13:54:27.544789+0000","last_clean":"2022-03-21T13:54:27.544789+0000","last_became_active":"2022-03-21T13:54:27.174313+0000","last_became_peered":"2022-03-21T13:54:27.174313+0000","last_unstale":"2022-03-21T13:54:27.544789+0000","last_undegraded":"2022-03-21T13:54:27.544789+0000","last_fullsized":"2022-03-21T13:54:27.544789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:31:14.846155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556557+0000","last_change":"2022-03-21T13:54:27.553933+0000","last_active":"2022-03-21T13:54:27.556557+0000","last_peered":"2022-03-21T13:54:27.556557+0000","last_clean":"2022-03-21T13:54:27.556557+0000","last_became_active":"2022-03-21T13:54:27.553667+0000","last_became_peered":"2022-03-21T13:54:27.553667+0000","last_unstale":"2022-03-21T13:54:27.556557+0000","last_undegraded":"2022-03-21T13:54:27.556557+0000","last_fullsized":"2022-03-21T13:54:27.556557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:51:01.974225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.184482+0000","last_change":"2022-03-21T13:54:27.181656+0000","last_active":"2022-03-21T13:54:27.184482+0000","last_peered":"2022-03-21T13:54:27.184482+0000","last_clean":"2022-03-21T13:54:27.184482+0000","last_became_active":"2022-03-21T13:54:27.181013+0000","last_became_peered":"2022-03-21T13:54:27.181013+0000","last_unstale":"2022-03-21T13:54:27.184482+0000","last_undegraded":"2022-03-21T13:54:27.184482+0000","last_fullsized":"2022-03-21T13:54:27.184482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:08:16.370281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559632+0000","last_change":"2022-03-21T13:54:27.552507+0000","last_active":"2022-03-21T13:54:27.559632+0000","last_peered":"2022-03-21T13:54:27.559632+0000","last_clean":"2022-03-21T13:54:27.559632+0000","last_became_active":"2022-03-21T13:54:27.552244+0000","last_became_peered":"2022-03-21T13:54:27.552244+0000","last_unstale":"2022-03-21T13:54:27.559632+0000","last_undegraded":"2022-03-21T13:54:27.559632+0000","last_fullsized":"2022-03-21T13:54:27.559632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:15:46.905402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.184000+0000","last_change":"2022-03-21T13:54:27.182220+0000","last_active":"2022-03-21T13:54:27.184000+0000","last_peered":"2022-03-21T13:54:27.184000+0000","last_clean":"2022-03-21T13:54:27.184000+0000","last_became_active":"2022-03-21T13:54:27.181449+0000","last_became_peered":"2022-03-21T13:54:27.181449+0000","last_unstale":"2022-03-21T13:54:27.184000+0000","last_undegraded":"2022-03-21T13:54:27.184000+0000","last_fullsized":"2022-03-21T13:54:27.184000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:26:28.829484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544372+0000","last_change":"2022-03-21T13:54:22.752657+0000","last_active":"2022-03-21T13:54:27.544372+0000","last_peered":"2022-03-21T13:54:27.544372+0000","last_clean":"2022-03-21T13:54:27.544372+0000","last_became_active":"2022-03-21T13:54:22.752340+0000","last_became_peered":"2022-03-21T13:54:22.752340+0000","last_unstale":"2022-03-21T13:54:27.544372+0000","last_undegraded":"2022-03-21T13:54:27.544372+0000","last_fullsized":"2022-03-21T13:54:27.544372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:28:57.302130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556126+0000","last_change":"2022-03-21T13:54:27.556126+0000","last_active":"2022-03-21T13:54:27.556126+0000","last_peered":"2022-03-21T13:54:27.556126+0000","last_clean":"2022-03-21T13:54:27.556126+0000","last_became_active":"2022-03-21T13:54:27.555851+0000","last_became_peered":"2022-03-21T13:54:27.555851+0000","last_unstale":"2022-03-21T13:54:27.556126+0000","last_undegraded":"2022-03-21T13:54:27.556126+0000","last_fullsized":"2022-03-21T13:54:27.556126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:16:33.357705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.164372+0000","last_change":"2022-03-21T13:54:22.516271+0000","last_active":"2022-03-21T13:54:27.164372+0000","last_peered":"2022-03-21T13:54:27.164372+0000","last_clean":"2022-03-21T13:54:27.164372+0000","last_became_active":"2022-03-21T13:54:22.516054+0000","last_became_peered":"2022-03-21T13:54:22.516054+0000","last_unstale":"2022-03-21T13:54:27.164372+0000","last_undegraded":"2022-03-21T13:54:27.164372+0000","last_fullsized":"2022-03-21T13:54:27.164372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:22:14.145694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.186006+0000","last_change":"2022-03-21T13:54:27.180161+0000","last_active":"2022-03-21T13:54:27.186006+0000","last_peered":"2022-03-21T13:54:27.186006+0000","last_clean":"2022-03-21T13:54:27.186006+0000","last_became_active":"2022-03-21T13:54:27.179861+0000","last_became_peered":"2022-03-21T13:54:27.179861+0000","last_unstale":"2022-03-21T13:54:27.186006+0000","last_undegraded":"2022-03-21T13:54:27.186006+0000","last_fullsized":"2022-03-21T13:54:27.186006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:54:59.570703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559390+0000","last_change":"2022-03-21T13:54:27.554664+0000","last_active":"2022-03-21T13:54:27.559390+0000","last_peered":"2022-03-21T13:54:27.559390+0000","last_clean":"2022-03-21T13:54:27.559390+0000","last_became_active":"2022-03-21T13:54:27.554348+0000","last_became_peered":"2022-03-21T13:54:27.554348+0000","last_unstale":"2022-03-21T13:54:27.559390+0000","last_undegraded":"2022-03-21T13:54:27.559390+0000","last_fullsized":"2022-03-21T13:54:27.559390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:57:45.927949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546570+0000","last_change":"2022-03-21T13:54:22.517332+0000","last_active":"2022-03-21T13:54:27.546570+0000","last_peered":"2022-03-21T13:54:27.546570+0000","last_clean":"2022-03-21T13:54:27.546570+0000","last_became_active":"2022-03-21T13:54:22.517041+0000","last_became_peered":"2022-03-21T13:54:22.517041+0000","last_unstale":"2022-03-21T13:54:27.546570+0000","last_undegraded":"2022-03-21T13:54:27.546570+0000","last_fullsized":"2022-03-21T13:54:27.546570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:35:30.629523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":162,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.168109+0000","last_change":"2022-03-21T13:54:22.518907+0000","last_active":"2022-03-21T13:54:27.168109+0000","last_peered":"2022-03-21T13:54:27.168109+0000","last_clean":"2022-03-21T13:54:27.168109+0000","last_became_active":"2022-03-21T13:54:22.518133+0000","last_became_peered":"2022-03-21T13:54:22.518133+0000","last_unstale":"2022-03-21T13:54:27.168109+0000","last_undegraded":"2022-03-21T13:54:27.168109+0000","last_fullsized":"2022-03-21T13:54:27.168109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:30:34.855709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.183345+0000","last_change":"2022-03-21T13:54:27.176117+0000","last_active":"2022-03-21T13:54:27.183345+0000","last_peered":"2022-03-21T13:54:27.183345+0000","last_clean":"2022-03-21T13:54:27.183345+0000","last_became_active":"2022-03-21T13:54:27.175777+0000","last_became_peered":"2022-03-21T13:54:27.175777+0000","last_unstale":"2022-03-21T13:54:27.183345+0000","last_undegraded":"2022-03-21T13:54:27.183345+0000","last_fullsized":"2022-03-21T13:54:27.183345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:10:54.616279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557887+0000","last_change":"2022-03-21T13:54:27.557887+0000","last_active":"2022-03-21T13:54:27.557887+0000","last_peered":"2022-03-21T13:54:27.557887+0000","last_clean":"2022-03-21T13:54:27.557887+0000","last_became_active":"2022-03-21T13:54:27.556863+0000","last_became_peered":"2022-03-21T13:54:27.556863+0000","last_unstale":"2022-03-21T13:54:27.557887+0000","last_undegraded":"2022-03-21T13:54:27.557887+0000","last_fullsized":"2022-03-21T13:54:27.557887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:12:33.174945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.168430+0000","last_change":"2022-03-21T13:54:22.754462+0000","last_active":"2022-03-21T13:54:27.168430+0000","last_peered":"2022-03-21T13:54:27.168430+0000","last_clean":"2022-03-21T13:54:27.168430+0000","last_became_active":"2022-03-21T13:54:22.754181+0000","last_became_peered":"2022-03-21T13:54:22.754181+0000","last_unstale":"2022-03-21T13:54:27.168430+0000","last_undegraded":"2022-03-21T13:54:27.168430+0000","last_fullsized":"2022-03-21T13:54:27.168430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:14:20.288360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.545206+0000","last_change":"2022-03-21T13:54:27.179213+0000","last_active":"2022-03-21T13:54:27.545206+0000","last_peered":"2022-03-21T13:54:27.545206+0000","last_clean":"2022-03-21T13:54:27.545206+0000","last_became_active":"2022-03-21T13:54:27.178915+0000","last_became_peered":"2022-03-21T13:54:27.178915+0000","last_unstale":"2022-03-21T13:54:27.545206+0000","last_undegraded":"2022-03-21T13:54:27.545206+0000","last_fullsized":"2022-03-21T13:54:27.545206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:13:42.024350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552944+0000","last_change":"2022-03-21T13:54:27.547854+0000","last_active":"2022-03-21T13:54:27.552944+0000","last_peered":"2022-03-21T13:54:27.552944+0000","last_clean":"2022-03-21T13:54:27.552944+0000","last_became_active":"2022-03-21T13:54:27.547604+0000","last_became_peered":"2022-03-21T13:54:27.547604+0000","last_unstale":"2022-03-21T13:54:27.552944+0000","last_undegraded":"2022-03-21T13:54:27.552944+0000","last_fullsized":"2022-03-21T13:54:27.552944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:32:19.271632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.167985+0000","last_change":"2022-03-21T13:54:22.754729+0000","last_active":"2022-03-21T13:54:27.167985+0000","last_peered":"2022-03-21T13:54:27.167985+0000","last_clean":"2022-03-21T13:54:27.167985+0000","last_became_active":"2022-03-21T13:54:22.754461+0000","last_became_peered":"2022-03-21T13:54:22.754461+0000","last_unstale":"2022-03-21T13:54:27.167985+0000","last_undegraded":"2022-03-21T13:54:27.167985+0000","last_fullsized":"2022-03-21T13:54:27.167985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:46:22.855169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.180680+0000","last_change":"2022-03-21T13:54:27.174663+0000","last_active":"2022-03-21T13:54:27.180680+0000","last_peered":"2022-03-21T13:54:27.180680+0000","last_clean":"2022-03-21T13:54:27.180680+0000","last_became_active":"2022-03-21T13:54:27.174374+0000","last_became_peered":"2022-03-21T13:54:27.174374+0000","last_unstale":"2022-03-21T13:54:27.180680+0000","last_undegraded":"2022-03-21T13:54:27.180680+0000","last_fullsized":"2022-03-21T13:54:27.180680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:56:26.094511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554233+0000","last_change":"2022-03-21T13:54:27.554233+0000","last_active":"2022-03-21T13:54:27.554233+0000","last_peered":"2022-03-21T13:54:27.554233+0000","last_clean":"2022-03-21T13:54:27.554233+0000","last_became_active":"2022-03-21T13:54:27.554000+0000","last_became_peered":"2022-03-21T13:54:27.554000+0000","last_unstale":"2022-03-21T13:54:27.554233+0000","last_undegraded":"2022-03-21T13:54:27.554233+0000","last_fullsized":"2022-03-21T13:54:27.554233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:06:56.350790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.539757+0000","last_change":"2022-03-21T13:54:22.754834+0000","last_active":"2022-03-21T13:54:27.539757+0000","last_peered":"2022-03-21T13:54:27.539757+0000","last_clean":"2022-03-21T13:54:27.539757+0000","last_became_active":"2022-03-21T13:54:22.754559+0000","last_became_peered":"2022-03-21T13:54:22.754559+0000","last_unstale":"2022-03-21T13:54:27.539757+0000","last_undegraded":"2022-03-21T13:54:27.539757+0000","last_fullsized":"2022-03-21T13:54:27.539757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:12:50.878537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544326+0000","last_change":"2022-03-21T13:54:27.181111+0000","last_active":"2022-03-21T13:54:27.544326+0000","last_peered":"2022-03-21T13:54:27.544326+0000","last_clean":"2022-03-21T13:54:27.544326+0000","last_became_active":"2022-03-21T13:54:27.180843+0000","last_became_peered":"2022-03-21T13:54:27.180843+0000","last_unstale":"2022-03-21T13:54:27.544326+0000","last_undegraded":"2022-03-21T13:54:27.544326+0000","last_fullsized":"2022-03-21T13:54:27.544326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:59:38.064620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563441+0000","last_change":"2022-03-21T13:54:27.559540+0000","last_active":"2022-03-21T13:54:27.563441+0000","last_peered":"2022-03-21T13:54:27.563441+0000","last_clean":"2022-03-21T13:54:27.563441+0000","last_became_active":"2022-03-21T13:54:27.559138+0000","last_became_peered":"2022-03-21T13:54:27.559138+0000","last_unstale":"2022-03-21T13:54:27.563441+0000","last_undegraded":"2022-03-21T13:54:27.563441+0000","last_fullsized":"2022-03-21T13:54:27.563441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:00:54.639756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.172900+0000","last_change":"2022-03-21T13:54:22.754654+0000","last_active":"2022-03-21T13:54:27.172900+0000","last_peered":"2022-03-21T13:54:27.172900+0000","last_clean":"2022-03-21T13:54:27.172900+0000","last_became_active":"2022-03-21T13:54:22.754341+0000","last_became_peered":"2022-03-21T13:54:22.754341+0000","last_unstale":"2022-03-21T13:54:27.172900+0000","last_undegraded":"2022-03-21T13:54:27.172900+0000","last_fullsized":"2022-03-21T13:54:27.172900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:03:23.378195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.545941+0000","last_change":"2022-03-21T13:54:27.177438+0000","last_active":"2022-03-21T13:54:27.545941+0000","last_peered":"2022-03-21T13:54:27.545941+0000","last_clean":"2022-03-21T13:54:27.545941+0000","last_became_active":"2022-03-21T13:54:27.177162+0000","last_became_peered":"2022-03-21T13:54:27.177162+0000","last_unstale":"2022-03-21T13:54:27.545941+0000","last_undegraded":"2022-03-21T13:54:27.545941+0000","last_fullsized":"2022-03-21T13:54:27.545941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:28:43.052052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561906+0000","last_change":"2022-03-21T13:54:27.561906+0000","last_active":"2022-03-21T13:54:27.561906+0000","last_peered":"2022-03-21T13:54:27.561906+0000","last_clean":"2022-03-21T13:54:27.561906+0000","last_became_active":"2022-03-21T13:54:27.561625+0000","last_became_peered":"2022-03-21T13:54:27.561625+0000","last_unstale":"2022-03-21T13:54:27.561906+0000","last_undegraded":"2022-03-21T13:54:27.561906+0000","last_fullsized":"2022-03-21T13:54:27.561906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:56:25.047015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.173128+0000","last_change":"2022-03-21T13:54:22.516420+0000","last_active":"2022-03-21T13:54:27.173128+0000","last_peered":"2022-03-21T13:54:27.173128+0000","last_clean":"2022-03-21T13:54:27.173128+0000","last_became_active":"2022-03-21T13:54:22.516110+0000","last_became_peered":"2022-03-21T13:54:22.516110+0000","last_unstale":"2022-03-21T13:54:27.173128+0000","last_undegraded":"2022-03-21T13:54:27.173128+0000","last_fullsized":"2022-03-21T13:54:27.173128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:05:13.607013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.539334+0000","last_change":"2022-03-21T13:54:27.173580+0000","last_active":"2022-03-21T13:54:27.539334+0000","last_peered":"2022-03-21T13:54:27.539334+0000","last_clean":"2022-03-21T13:54:27.539334+0000","last_became_active":"2022-03-21T13:54:27.173258+0000","last_became_peered":"2022-03-21T13:54:27.173258+0000","last_unstale":"2022-03-21T13:54:27.539334+0000","last_undegraded":"2022-03-21T13:54:27.539334+0000","last_fullsized":"2022-03-21T13:54:27.539334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:47:44.915765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552991+0000","last_change":"2022-03-21T13:54:27.548735+0000","last_active":"2022-03-21T13:54:27.552991+0000","last_peered":"2022-03-21T13:54:27.552991+0000","last_clean":"2022-03-21T13:54:27.552991+0000","last_became_active":"2022-03-21T13:54:27.548473+0000","last_became_peered":"2022-03-21T13:54:27.548473+0000","last_unstale":"2022-03-21T13:54:27.552991+0000","last_undegraded":"2022-03-21T13:54:27.552991+0000","last_fullsized":"2022-03-21T13:54:27.552991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:39:55.442576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.190291+0000","last_change":"2022-03-21T13:54:27.189213+0000","last_active":"2022-03-21T13:54:27.190291+0000","last_peered":"2022-03-21T13:54:27.190291+0000","last_clean":"2022-03-21T13:54:27.190291+0000","last_became_active":"2022-03-21T13:54:27.188926+0000","last_became_peered":"2022-03-21T13:54:27.188926+0000","last_unstale":"2022-03-21T13:54:27.190291+0000","last_undegraded":"2022-03-21T13:54:27.190291+0000","last_fullsized":"2022-03-21T13:54:27.190291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:16:55.866231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561826+0000","last_change":"2022-03-21T13:54:27.556471+0000","last_active":"2022-03-21T13:54:27.561826+0000","last_peered":"2022-03-21T13:54:27.561826+0000","last_clean":"2022-03-21T13:54:27.561826+0000","last_became_active":"2022-03-21T13:54:27.556191+0000","last_became_peered":"2022-03-21T13:54:27.556191+0000","last_unstale":"2022-03-21T13:54:27.561826+0000","last_undegraded":"2022-03-21T13:54:27.561826+0000","last_fullsized":"2022-03-21T13:54:27.561826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:05:34.443958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538479+0000","last_change":"2022-03-21T13:54:27.177405+0000","last_active":"2022-03-21T13:54:27.538479+0000","last_peered":"2022-03-21T13:54:27.538479+0000","last_clean":"2022-03-21T13:54:27.538479+0000","last_became_active":"2022-03-21T13:54:27.177179+0000","last_became_peered":"2022-03-21T13:54:27.177179+0000","last_unstale":"2022-03-21T13:54:27.538479+0000","last_undegraded":"2022-03-21T13:54:27.538479+0000","last_fullsized":"2022-03-21T13:54:27.538479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:41:46.492410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556386+0000","last_change":"2022-03-21T13:54:27.552397+0000","last_active":"2022-03-21T13:54:27.556386+0000","last_peered":"2022-03-21T13:54:27.556386+0000","last_clean":"2022-03-21T13:54:27.556386+0000","last_became_active":"2022-03-21T13:54:27.552124+0000","last_became_peered":"2022-03-21T13:54:27.552124+0000","last_unstale":"2022-03-21T13:54:27.556386+0000","last_undegraded":"2022-03-21T13:54:27.556386+0000","last_fullsized":"2022-03-21T13:54:27.556386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:53:44.559771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.539435+0000","last_change":"2022-03-21T13:54:27.174486+0000","last_active":"2022-03-21T13:54:27.539435+0000","last_peered":"2022-03-21T13:54:27.539435+0000","last_clean":"2022-03-21T13:54:27.539435+0000","last_became_active":"2022-03-21T13:54:27.174216+0000","last_became_peered":"2022-03-21T13:54:27.174216+0000","last_unstale":"2022-03-21T13:54:27.539435+0000","last_undegraded":"2022-03-21T13:54:27.539435+0000","last_fullsized":"2022-03-21T13:54:27.539435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:48:33.845336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552669+0000","last_change":"2022-03-21T13:54:27.545286+0000","last_active":"2022-03-21T13:54:27.552669+0000","last_peered":"2022-03-21T13:54:27.552669+0000","last_clean":"2022-03-21T13:54:27.552669+0000","last_became_active":"2022-03-21T13:54:27.544961+0000","last_became_peered":"2022-03-21T13:54:27.544961+0000","last_unstale":"2022-03-21T13:54:27.552669+0000","last_undegraded":"2022-03-21T13:54:27.552669+0000","last_fullsized":"2022-03-21T13:54:27.552669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:48:39.601897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.183314+0000","last_change":"2022-03-21T13:54:27.178370+0000","last_active":"2022-03-21T13:54:27.183314+0000","last_peered":"2022-03-21T13:54:27.183314+0000","last_clean":"2022-03-21T13:54:27.183314+0000","last_became_active":"2022-03-21T13:54:27.178080+0000","last_became_peered":"2022-03-21T13:54:27.178080+0000","last_unstale":"2022-03-21T13:54:27.183314+0000","last_undegraded":"2022-03-21T13:54:27.183314+0000","last_fullsized":"2022-03-21T13:54:27.183314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:27:35.506923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557416+0000","last_change":"2022-03-21T13:54:27.557416+0000","last_active":"2022-03-21T13:54:27.557416+0000","last_peered":"2022-03-21T13:54:27.557416+0000","last_clean":"2022-03-21T13:54:27.557416+0000","last_became_active":"2022-03-21T13:54:27.557109+0000","last_became_peered":"2022-03-21T13:54:27.557109+0000","last_unstale":"2022-03-21T13:54:27.557416+0000","last_undegraded":"2022-03-21T13:54:27.557416+0000","last_fullsized":"2022-03-21T13:54:27.557416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:54:56.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.183503+0000","last_change":"2022-03-21T13:54:27.177642+0000","last_active":"2022-03-21T13:54:27.183503+0000","last_peered":"2022-03-21T13:54:27.183503+0000","last_clean":"2022-03-21T13:54:27.183503+0000","last_became_active":"2022-03-21T13:54:27.176415+0000","last_became_peered":"2022-03-21T13:54:27.176415+0000","last_unstale":"2022-03-21T13:54:27.183503+0000","last_undegraded":"2022-03-21T13:54:27.183503+0000","last_fullsized":"2022-03-21T13:54:27.183503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:07:20.332858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554536+0000","last_change":"2022-03-21T13:54:27.548038+0000","last_active":"2022-03-21T13:54:27.554536+0000","last_peered":"2022-03-21T13:54:27.554536+0000","last_clean":"2022-03-21T13:54:27.554536+0000","last_became_active":"2022-03-21T13:54:27.547693+0000","last_became_peered":"2022-03-21T13:54:27.547693+0000","last_unstale":"2022-03-21T13:54:27.554536+0000","last_undegraded":"2022-03-21T13:54:27.554536+0000","last_fullsized":"2022-03-21T13:54:27.554536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:20:34.987871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557329+0000","last_change":"2022-03-21T13:54:27.557329+0000","last_active":"2022-03-21T13:54:27.557329+0000","last_peered":"2022-03-21T13:54:27.557329+0000","last_clean":"2022-03-21T13:54:27.557329+0000","last_became_active":"2022-03-21T13:54:27.557050+0000","last_became_peered":"2022-03-21T13:54:27.557050+0000","last_unstale":"2022-03-21T13:54:27.557329+0000","last_undegraded":"2022-03-21T13:54:27.557329+0000","last_fullsized":"2022-03-21T13:54:27.557329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:29:21.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554172+0000","last_change":"2022-03-21T13:54:27.554172+0000","last_active":"2022-03-21T13:54:27.554172+0000","last_peered":"2022-03-21T13:54:27.554172+0000","last_clean":"2022-03-21T13:54:27.554172+0000","last_became_active":"2022-03-21T13:54:27.553846+0000","last_became_peered":"2022-03-21T13:54:27.553846+0000","last_unstale":"2022-03-21T13:54:27.554172+0000","last_undegraded":"2022-03-21T13:54:27.554172+0000","last_fullsized":"2022-03-21T13:54:27.554172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:26:44.119561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554578+0000","last_change":"2022-03-21T13:54:27.547824+0000","last_active":"2022-03-21T13:54:27.554578+0000","last_peered":"2022-03-21T13:54:27.554578+0000","last_clean":"2022-03-21T13:54:27.554578+0000","last_became_active":"2022-03-21T13:54:27.547518+0000","last_became_peered":"2022-03-21T13:54:27.547518+0000","last_unstale":"2022-03-21T13:54:27.554578+0000","last_undegraded":"2022-03-21T13:54:27.554578+0000","last_fullsized":"2022-03-21T13:54:27.554578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:51:03.595275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557697+0000","last_change":"2022-03-21T13:54:27.557697+0000","last_active":"2022-03-21T13:54:27.557697+0000","last_peered":"2022-03-21T13:54:27.557697+0000","last_clean":"2022-03-21T13:54:27.557697+0000","last_became_active":"2022-03-21T13:54:27.557422+0000","last_became_peered":"2022-03-21T13:54:27.557422+0000","last_unstale":"2022-03-21T13:54:27.557697+0000","last_undegraded":"2022-03-21T13:54:27.557697+0000","last_fullsized":"2022-03-21T13:54:27.557697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:19:10.850615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562316+0000","last_change":"2022-03-21T13:54:27.555304+0000","last_active":"2022-03-21T13:54:27.562316+0000","last_peered":"2022-03-21T13:54:27.562316+0000","last_clean":"2022-03-21T13:54:27.562316+0000","last_became_active":"2022-03-21T13:54:27.555046+0000","last_became_peered":"2022-03-21T13:54:27.555046+0000","last_unstale":"2022-03-21T13:54:27.562316+0000","last_undegraded":"2022-03-21T13:54:27.562316+0000","last_fullsized":"2022-03-21T13:54:27.562316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:20:53.409319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":58760,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8896,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362944,"statfs":{"total":96636764160,"available":96627654656,"internally_reserved":0,"allocated":253952,"data_stored":596467,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8388,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363452,"statfs":{"total":96636764160,"available":96628174848,"internally_reserved":0,"allocated":192512,"data_stored":67539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8972,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362868,"statfs":{"total":96636764160,"available":96627576832,"internally_reserved":0,"allocated":266240,"data_stored":603108,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8388,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363452,"statfs":{"total":96636764160,"available":96628174848,"internally_reserved":0,"allocated":192512,"data_stored":67539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":74180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":192512,"data_stored":67539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8464,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363376,"statfs":{"total":96636764160,"available":96628097024,"internally_reserved":0,"allocated":204800,"data_stored":74180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":74180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-03-21T13:54:33.569 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2022-03-21T13:54:33.570 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-03-21T13:54:33.571 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-03-21T13:54:33.571 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-03-21T13:54:33.572 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2022-03-21T13:54:33.712 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.711+0000 7feb29a74700 1 Processor -- start 2022-03-21T13:54:33.713 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.711+0000 7feb29a74700 1 -- start start 2022-03-21T13:54:33.716 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb29a74700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7feb2406c1c0 0x7feb240c0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.716 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb29a74700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb2414ce20 0x7feb240c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.716 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb29a74700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2406d910 con 0x7feb2414ca50 2022-03-21T13:54:33.716 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb29a74700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb240c4f50 con 0x7feb2406c1c0 2022-03-21T13:54:33.717 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb29a74700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2406ded0 con 0x7feb2414ce20 2022-03-21T13:54:33.717 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb23fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7feb2406c1c0 0x7feb240c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.717 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb23fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7feb2406c1c0 0x7feb240c0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56414/0 (socket says 172.21.15.160:56414) 2022-03-21T13:54:33.717 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb23fff700 1 -- 172.21.15.160:0/3286477423 learned_addr learned my addr 172.21.15.160:0/3286477423 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:33.718 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb28a72700 1 --1- 172.21.15.160:0/3286477423 >> v1:172.21.15.160:6789/0 conn(0x7feb2414ca50 0x7feb2406cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59562/0 (socket says 172.21.15.160:59562) 2022-03-21T13:54:33.718 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb29273700 1 --2- 172.21.15.160:0/3286477423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb2414ce20 0x7feb240c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.718 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb23fff700 1 -- 172.21.15.160:0/3286477423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb2414ce20 msgr2=0x7feb240c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:33.718 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb23fff700 1 --2- 172.21.15.160:0/3286477423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb2414ce20 0x7feb240c08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.718 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb23fff700 1 -- 172.21.15.160:0/3286477423 >> v1:172.21.15.160:6789/0 conn(0x7feb2414ca50 legacy=0x7feb2406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.719 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb237fe700 1 -- 172.21.15.160:0/3286477423 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46115218 0 0) 0x7feb2406d910 con 0x7feb2414ca50 2022-03-21T13:54:33.719 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb23fff700 1 -- 172.21.15.160:0/3286477423 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240c2b80 con 0x7feb2406c1c0 2022-03-21T13:54:33.719 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb29273700 1 --2- 172.21.15.160:0/3286477423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb2414ce20 0x7feb240c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:54:33.719 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb23fff700 1 --2- 172.21.15.160:0/3286477423 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb2406c1c0 0x7feb240c0390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb10006fd0 tx=0x7feb100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e995600a7556e445 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:33.720 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb237fe700 1 -- 172.21.15.160:0/3286477423 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10004030 con 0x7feb2406c1c0 2022-03-21T13:54:33.720 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb237fe700 1 -- 172.21.15.160:0/3286477423 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb10004190 con 0x7feb2406c1c0 2022-03-21T13:54:33.720 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.712+0000 7feb237fe700 1 -- 172.21.15.160:0/3286477423 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10011630 con 0x7feb2406c1c0 2022-03-21T13:54:33.720 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.713+0000 7feb29a74700 1 -- 172.21.15.160:0/3286477423 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb2406c1c0 msgr2=0x7feb240c0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.720 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.713+0000 7feb29a74700 1 --2- 172.21.15.160:0/3286477423 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb2406c1c0 0x7feb240c0390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb10006fd0 tx=0x7feb100090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.721 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.713+0000 7feb29a74700 1 -- 172.21.15.160:0/3286477423 shutdown_connections 2022-03-21T13:54:33.721 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.713+0000 7feb29a74700 1 --2- 172.21.15.160:0/3286477423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb2414ce20 0x7feb240c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.721 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.713+0000 7feb29a74700 1 --2- 172.21.15.160:0/3286477423 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb2406c1c0 0x7feb240c0390 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.721 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.713+0000 7feb29a74700 1 -- 172.21.15.160:0/3286477423 >> 172.21.15.160:0/3286477423 conn(0x7feb240c9710 msgr2=0x7feb240c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:33.721 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.713+0000 7feb29a74700 1 -- 172.21.15.160:0/3286477423 shutdown_connections 2022-03-21T13:54:33.721 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.713+0000 7feb29a74700 1 -- 172.21.15.160:0/3286477423 wait complete. 2022-03-21T13:54:33.722 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.714+0000 7feb29a74700 1 Processor -- start 2022-03-21T13:54:33.722 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.714+0000 7feb29a74700 1 -- start start 2022-03-21T13:54:33.724 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29a74700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb2406c1c0 0x7feb24152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.724 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29a74700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb2414ca50 0x7feb24066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.725 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29a74700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb2414ce20 0x7feb24067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.725 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29a74700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2414f3d0 con 0x7feb2414ce20 2022-03-21T13:54:33.725 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29a74700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb24066a80 con 0x7feb2414ca50 2022-03-21T13:54:33.725 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29a74700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb24165740 con 0x7feb2406c1c0 2022-03-21T13:54:33.725 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29273700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb2414ce20 0x7feb24067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.726 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29273700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb2414ce20 0x7feb24067410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56420/0 (socket says 172.21.15.160:56420) 2022-03-21T13:54:33.726 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29273700 1 -- 172.21.15.160:0/2298228874 learned_addr learned my addr 172.21.15.160:0/2298228874 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:33.726 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29273700 1 -- 172.21.15.160:0/2298228874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb2406c1c0 msgr2=0x7feb24152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.726 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29273700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb2406c1c0 0x7feb24152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.727 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29273700 1 -- 172.21.15.160:0/2298228874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb2414ca50 msgr2=0x7feb24066ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.727 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29273700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb2414ca50 0x7feb24066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.727 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29273700 1 -- 172.21.15.160:0/2298228874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb10009370 con 0x7feb2414ce20 2022-03-21T13:54:33.727 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29273700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb2414ce20 0x7feb24067410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00cfc0 tx=0x7feb1c0078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:33.727 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb20ff9700 1 -- 172.21.15.160:0/2298228874 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c015440 con 0x7feb2414ce20 2022-03-21T13:54:33.728 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb20ff9700 1 -- 172.21.15.160:0/2298228874 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c0155a0 con 0x7feb2414ce20 2022-03-21T13:54:33.728 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb20ff9700 1 -- 172.21.15.160:0/2298228874 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c015960 con 0x7feb2414ce20 2022-03-21T13:54:33.728 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.715+0000 7feb29a74700 1 -- 172.21.15.160:0/2298228874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb240689a0 con 0x7feb2414ce20 2022-03-21T13:54:33.728 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.716+0000 7feb29a74700 1 -- 172.21.15.160:0/2298228874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb24067fe0 con 0x7feb2414ce20 2022-03-21T13:54:33.729 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.716+0000 7feb29a74700 1 -- 172.21.15.160:0/2298228874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2406fec0 con 0x7feb2414ce20 2022-03-21T13:54:33.729 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.717+0000 7feb20ff9700 1 -- 172.21.15.160:0/2298228874 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7feb1c01c030 con 0x7feb2414ce20 2022-03-21T13:54:33.729 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.717+0000 7feb20ff9700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7feb0c063ce0 0x7feb0c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:33.729 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.717+0000 7feb28a72700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7feb0c063ce0 0x7feb0c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:33.729 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.717+0000 7feb20ff9700 1 -- 172.21.15.160:0/2298228874 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feb1c0812e0 con 0x7feb2414ce20 2022-03-21T13:54:33.730 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.718+0000 7feb28a72700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7feb0c063ce0 0x7feb0c066190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb18001570 tx=0x7feb18007760 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:33.730 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.721+0000 7feb20ff9700 1 -- 172.21.15.160:0/2298228874 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7feb1c04fec0 con 0x7feb2414ce20 2022-03-21T13:54:33.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.939+0000 7feb29a74700 1 -- 172.21.15.160:0/2298228874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7feb24066bf0 con 0x7feb2414ce20 2022-03-21T13:54:33.943 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.942+0000 7feb20ff9700 1 -- 172.21.15.160:0/2298228874 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+158618 (secure 0 0 0) 0x7feb24066bf0 con 0x7feb2414ce20 2022-03-21T13:54:33.946 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:33.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 -- 172.21.15.160:0/2298228874 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7feb0c063ce0 msgr2=0x7feb0c066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7feb0c063ce0 0x7feb0c066190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb18001570 tx=0x7feb18007760 comp rx=0 tx=0).stop 2022-03-21T13:54:33.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 -- 172.21.15.160:0/2298228874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb2414ce20 msgr2=0x7feb24067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:33.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb2414ce20 0x7feb24067410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00cfc0 tx=0x7feb1c0078d0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 -- 172.21.15.160:0/2298228874 shutdown_connections 2022-03-21T13:54:33.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7feb0c063ce0 0x7feb0c066190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb2414ce20 0x7feb24067410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb2406c1c0 0x7feb24152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.950 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 --2- 172.21.15.160:0/2298228874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb2414ca50 0x7feb24066ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:33.950 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 -- 172.21.15.160:0/2298228874 >> 172.21.15.160:0/2298228874 conn(0x7feb240c9710 msgr2=0x7feb241556f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:33.950 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 -- 172.21.15.160:0/2298228874 shutdown_connections 2022-03-21T13:54:33.950 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:33.944+0000 7feb29a74700 1 -- 172.21.15.160:0/2298228874 wait complete. 2022-03-21T13:54:33.958 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":25205},{"type":"v1","addr":"172.21.15.160:6833","nonce":25205}]},"active_addr":"172.21.15.160:6833/25205","active_change":"2022-03-21T13:54:15.450511+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":1007100234}]},{"addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":510916919}]},{"addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":1184852054}]},{"addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":2960561275}]}]}} 2022-03-21T13:54:33.963 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-03-21T13:54:33.963 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-03-21T13:54:33.964 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-21T13:54:34.088 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.076+0000 7fa3f9e06700 1 Processor -- start 2022-03-21T13:54:34.089 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.076+0000 7fa3f9e06700 1 -- start start 2022-03-21T13:54:34.089 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.076+0000 7fa3f9e06700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414cc30 0x7fa3f40c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.089 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.076+0000 7fa3f9e06700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa3f40c4eb0 0x7fa3f4152b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.090 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.076+0000 7fa3f9e06700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f40c0310 con 0x7fa3f414d000 2022-03-21T13:54:34.090 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.076+0000 7fa3f9e06700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f40c13c0 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.090 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.076+0000 7fa3f9e06700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40c39a0 con 0x7fa3f414cc30 2022-03-21T13:54:34.091 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3f37fe700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414cc30 0x7fa3f40c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.091 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3f3fff700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa3f40c4eb0 0x7fa3f4152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.091 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3f37fe700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414cc30 0x7fa3f40c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:46820/0 (socket says 172.21.15.160:46820) 2022-03-21T13:54:34.092 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3eaffd700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa3f414d000 0x7fa3f40c47a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:52666/0 (socket says 172.21.15.160:52666) 2022-03-21T13:54:34.092 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3f37fe700 1 -- 172.21.15.160:0/3896604819 learned_addr learned my addr 172.21.15.160:0/3896604819 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.092 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3f37fe700 1 -- 172.21.15.160:0/3896604819 >> v2:172.21.15.171:3300/0 conn(0x7fa3f40c4eb0 msgr2=0x7fa3f4152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.093 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3f37fe700 1 --2- 172.21.15.160:0/3896604819 >> v2:172.21.15.171:3300/0 conn(0x7fa3f40c4eb0 0x7fa3f4152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.093 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3f37fe700 1 -- 172.21.15.160:0/3896604819 >> v1:172.21.15.171:6789/0 conn(0x7fa3f414d000 legacy=0x7fa3f40c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.093 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3f37fe700 1 -- 172.21.15.160:0/3896604819 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f406de00 con 0x7fa3f414cc30 2022-03-21T13:54:34.094 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3f37fe700 1 --2- 172.21.15.160:0/3896604819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414cc30 0x7fa3f40c6280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4006fd0 tx=0x7fa3e40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2cc4bf4f9efbc89 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.094 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3f2ffd700 1 -- 172.21.15.160:0/3896604819 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4004030 con 0x7fa3f414cc30 2022-03-21T13:54:34.095 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.077+0000 7fa3f2ffd700 1 -- 172.21.15.160:0/3896604819 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e40041d0 con 0x7fa3f414cc30 2022-03-21T13:54:34.096 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.078+0000 7fa3f2ffd700 1 -- 172.21.15.160:0/3896604819 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4011630 con 0x7fa3f414cc30 2022-03-21T13:54:34.096 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.078+0000 7fa3f9e06700 1 -- 172.21.15.160:0/3896604819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414cc30 msgr2=0x7fa3f40c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.097 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.078+0000 7fa3f9e06700 1 --2- 172.21.15.160:0/3896604819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414cc30 0x7fa3f40c6280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4006fd0 tx=0x7fa3e40090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.097 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.078+0000 7fa3f9e06700 1 -- 172.21.15.160:0/3896604819 shutdown_connections 2022-03-21T13:54:34.098 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.078+0000 7fa3f9e06700 1 --2- 172.21.15.160:0/3896604819 >> v2:172.21.15.171:3300/0 conn(0x7fa3f40c4eb0 0x7fa3f4152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.099 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.078+0000 7fa3f9e06700 1 --2- 172.21.15.160:0/3896604819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414cc30 0x7fa3f40c6280 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.099 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.078+0000 7fa3f9e06700 1 -- 172.21.15.160:0/3896604819 >> 172.21.15.160:0/3896604819 conn(0x7fa3f40c98f0 msgr2=0x7fa3f40c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.099 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.078+0000 7fa3f9e06700 1 -- 172.21.15.160:0/3896604819 shutdown_connections 2022-03-21T13:54:34.100 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.078+0000 7fa3f9e06700 1 -- 172.21.15.160:0/3896604819 wait complete. 2022-03-21T13:54:34.100 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.079+0000 7fa3f9e06700 1 Processor -- start 2022-03-21T13:54:34.100 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.079+0000 7fa3f9e06700 1 -- start start 2022-03-21T13:54:34.101 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f9e06700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f40c4eb0 0x7fa3f4152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.101 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f9e06700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3f414cc30 0x7fa3f4158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.101 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f9e06700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414d000 0x7fa3f4164800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.101 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f9e06700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40be9b0 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.102 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f9e06700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40673c0 con 0x7fa3f414cc30 2022-03-21T13:54:34.102 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f9e06700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40681a0 con 0x7fa3f414d000 2022-03-21T13:54:34.102 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f40c4eb0 0x7fa3f4152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.103 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f40c4eb0 0x7fa3f4152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56428/0 (socket says 172.21.15.160:56428) 2022-03-21T13:54:34.103 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f37fe700 1 -- 172.21.15.160:0/940548183 learned_addr learned my addr 172.21.15.160:0/940548183 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.103 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f3fff700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414d000 0x7fa3f4164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.104 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3eaffd700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3f414cc30 0x7fa3f4158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.104 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f37fe700 1 -- 172.21.15.160:0/940548183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414d000 msgr2=0x7fa3f4164800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.104 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f37fe700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414d000 0x7fa3f4164800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.105 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f37fe700 1 -- 172.21.15.160:0/940548183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3f414cc30 msgr2=0x7fa3f4158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.105 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f37fe700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3f414cc30 0x7fa3f4158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.105 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f37fe700 1 -- 172.21.15.160:0/940548183 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4009370 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.105 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.080+0000 7fa3f37fe700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f40c4eb0 0x7fa3f4152d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4008000 tx=0x7fa3e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.106 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.081+0000 7fa3ebfff700 1 -- 172.21.15.160:0/940548183 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e40036f0 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.106 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.081+0000 7fa3ebfff700 1 -- 172.21.15.160:0/940548183 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e4003870 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.106 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.081+0000 7fa3f9e06700 1 -- 172.21.15.160:0/940548183 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f4068440 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.107 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.081+0000 7fa3ebfff700 1 -- 172.21.15.160:0/940548183 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4003c30 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.107 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.081+0000 7fa3f9e06700 1 -- 172.21.15.160:0/940548183 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f406cd30 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.107 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.081+0000 7fa3f9e06700 1 -- 172.21.15.160:0/940548183 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f406fc00 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.108 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.082+0000 7fa3ebfff700 1 -- 172.21.15.160:0/940548183 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fa3e4017020 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.108 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.082+0000 7fa3ebfff700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa3d8063ce0 0x7fa3d8066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.108 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.082+0000 7fa3ebfff700 1 -- 172.21.15.160:0/940548183 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa3e4082290 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.109 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.082+0000 7fa3eaffd700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa3d8063ce0 0x7fa3d8066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.109 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.083+0000 7fa3eaffd700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa3d8063ce0 0x7fa3d8066190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40c74b0 tx=0x7fa3dc007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.109 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.086+0000 7fa3ebfff700 1 -- 172.21.15.160:0/940548183 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fa3e4050d80 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.261+0000 7fa3f9e06700 1 -- 172.21.15.160:0/940548183 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3f406e740 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.264 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.262+0000 7fa3ebfff700 1 -- 172.21.15.160:0/940548183 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16893 (secure 0 0 0) 0x7fa3e402a090 con 0x7fa3f40c4eb0 2022-03-21T13:54:34.265 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:34.266 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":20,"fsid":"b2a3ddc8-064e-4cc9-8187-33ea19afd50a","created":"2022-03-21T13:54:10.384226+0000","modified":"2022-03-21T13:54:28.535055+0000","last_up_change":"2022-03-21T13:54:20.412036+0000","last_in_change":"2022-03-21T13:54:12.760084+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-03-21T13:54:21.458770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-03-21T13:54:21.499620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-21T13:54:25.482900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-21T13:54:26.501704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"828ac39d-86ad-44a1-bb66-c99786642970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":25441},{"type":"v1","addr":"172.21.15.160:6810","nonce":25441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":25441},{"type":"v1","addr":"172.21.15.160:6814","nonce":25441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":25441},{"type":"v1","addr":"172.21.15.160:6822","nonce":25441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":25441},{"type":"v1","addr":"172.21.15.160:6818","nonce":25441}]},"public_addr":"172.21.15.160:6810/25441","cluster_addr":"172.21.15.160:6814/25441","heartbeat_back_addr":"172.21.15.160:6822/25441","heartbeat_front_addr":"172.21.15.160:6818/25441","state":["exists","up"]},{"osd":1,"uuid":"464764e2-a47e-43c0-8c93-b6bfd10ba526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":25442},{"type":"v1","addr":"172.21.15.160:6825","nonce":25442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":25442},{"type":"v1","addr":"172.21.15.160:6827","nonce":25442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":25442},{"type":"v1","addr":"172.21.15.160:6831","nonce":25442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":25442},{"type":"v1","addr":"172.21.15.160:6829","nonce":25442}]},"public_addr":"172.21.15.160:6825/25442","cluster_addr":"172.21.15.160:6827/25442","heartbeat_back_addr":"172.21.15.160:6831/25442","heartbeat_front_addr":"172.21.15.160:6829/25442","state":["exists","up"]},{"osd":2,"uuid":"4dbfea57-14b6-4c67-8312-fc7d71ef77a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":25443},{"type":"v1","addr":"172.21.15.160:6811","nonce":25443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6813","nonce":25443},{"type":"v1","addr":"172.21.15.160:6815","nonce":25443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":25443},{"type":"v1","addr":"172.21.15.160:6823","nonce":25443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":25443},{"type":"v1","addr":"172.21.15.160:6819","nonce":25443}]},"public_addr":"172.21.15.160:6811/25443","cluster_addr":"172.21.15.160:6815/25443","heartbeat_back_addr":"172.21.15.160:6823/25443","heartbeat_front_addr":"172.21.15.160:6819/25443","state":["exists","up"]},{"osd":3,"uuid":"c53ed58d-a1f3-4783-8677-9348a1d103f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":25440},{"type":"v1","addr":"172.21.15.160:6801","nonce":25440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":25440},{"type":"v1","addr":"172.21.15.160:6803","nonce":25440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":25440},{"type":"v1","addr":"172.21.15.160:6807","nonce":25440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":25440},{"type":"v1","addr":"172.21.15.160:6805","nonce":25440}]},"public_addr":"172.21.15.160:6801/25440","cluster_addr":"172.21.15.160:6803/25440","heartbeat_back_addr":"172.21.15.160:6807/25440","heartbeat_front_addr":"172.21.15.160:6805/25440","state":["exists","up"]},{"osd":4,"uuid":"5713dbd4-1736-4ebf-8102-e80f4db6bcc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":25559},{"type":"v1","addr":"172.21.15.171:6817","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":25559},{"type":"v1","addr":"172.21.15.171:6819","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":25559},{"type":"v1","addr":"172.21.15.171:6826","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":25559},{"type":"v1","addr":"172.21.15.171:6821","nonce":25559}]},"public_addr":"172.21.15.171:6817/25559","cluster_addr":"172.21.15.171:6819/25559","heartbeat_back_addr":"172.21.15.171:6826/25559","heartbeat_front_addr":"172.21.15.171:6821/25559","state":["exists","up"]},{"osd":5,"uuid":"dfe21128-6ae6-4662-9f47-1bbb423a2232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":25549},{"type":"v1","addr":"172.21.15.171:6801","nonce":25549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":25549},{"type":"v1","addr":"172.21.15.171:6803","nonce":25549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":25549},{"type":"v1","addr":"172.21.15.171:6807","nonce":25549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":25549},{"type":"v1","addr":"172.21.15.171:6805","nonce":25549}]},"public_addr":"172.21.15.171:6801/25549","cluster_addr":"172.21.15.171:6803/25549","heartbeat_back_addr":"172.21.15.171:6807/25549","heartbeat_front_addr":"172.21.15.171:6805/25549","state":["exists","up"]},{"osd":6,"uuid":"24a9b956-5fa1-41bf-a689-0f048b7f19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":25574},{"type":"v1","addr":"172.21.15.171:6823","nonce":25574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":25574},{"type":"v1","addr":"172.21.15.171:6827","nonce":25574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":25574},{"type":"v1","addr":"172.21.15.171:6831","nonce":25574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":25574},{"type":"v1","addr":"172.21.15.171:6829","nonce":25574}]},"public_addr":"172.21.15.171:6823/25574","cluster_addr":"172.21.15.171:6827/25574","heartbeat_back_addr":"172.21.15.171:6831/25574","heartbeat_front_addr":"172.21.15.171:6829/25574","state":["exists","up"]},{"osd":7,"uuid":"a5ab4a14-8a7b-43b8-932c-a950f81c10f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":25550},{"type":"v1","addr":"172.21.15.171:6809","nonce":25550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":25550},{"type":"v1","addr":"172.21.15.171:6811","nonce":25550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":25550},{"type":"v1","addr":"172.21.15.171:6815","nonce":25550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":25550},{"type":"v1","addr":"172.21.15.171:6813","nonce":25550}]},"public_addr":"172.21.15.171:6809/25550","cluster_addr":"172.21.15.171:6811/25550","heartbeat_back_addr":"172.21.15.171:6815/25550","heartbeat_front_addr":"172.21.15.171:6813/25550","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.888796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.906098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.896027+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.876694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954695+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.846031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.883631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-21T13:54:34.267 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 -- 172.21.15.160:0/940548183 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa3d8063ce0 msgr2=0x7fa3d8066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.268 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa3d8063ce0 0x7fa3d8066190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40c74b0 tx=0x7fa3dc007d30 comp rx=0 tx=0).stop 2022-03-21T13:54:34.268 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 -- 172.21.15.160:0/940548183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f40c4eb0 msgr2=0x7fa3f4152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.268 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f40c4eb0 0x7fa3f4152d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4008000 tx=0x7fa3e4016000 comp rx=0 tx=0).stop 2022-03-21T13:54:34.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 -- 172.21.15.160:0/940548183 shutdown_connections 2022-03-21T13:54:34.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa3d8063ce0 0x7fa3d8066190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3f414d000 0x7fa3f4164800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f40c4eb0 0x7fa3f4152d30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 --2- 172.21.15.160:0/940548183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3f414cc30 0x7fa3f4158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 -- 172.21.15.160:0/940548183 >> 172.21.15.160:0/940548183 conn(0x7fa3f40c98f0 msgr2=0x7fa3f414c400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.271 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 -- 172.21.15.160:0/940548183 shutdown_connections 2022-03-21T13:54:34.271 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.264+0000 7fa3f9e06700 1 -- 172.21.15.160:0/940548183 wait complete. 2022-03-21T13:54:34.279 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-03-21T13:54:34.279 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-21T13:54:34.402 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.392+0000 7ffa91a27700 1 Processor -- start 2022-03-21T13:54:34.403 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.392+0000 7ffa91a27700 1 -- start start 2022-03-21T13:54:34.403 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa91a27700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8c05dc80 0x7ffa8c158940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.403 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa91a27700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ffa8c0c1f40 0x7ffa8c0c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.404 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa91a27700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8c1558b0 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.404 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa91a27700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8c0c37f0 con 0x7ffa8c0c1f40 2022-03-21T13:54:34.404 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa91a27700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0c2900 con 0x7ffa8c05dc80 2022-03-21T13:54:34.405 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa8b7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ffa8c0c1f40 0x7ffa8c0c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.405 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa8affd700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7ffa8c14ebe0 0x7ffa8c0c3c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59588/0 (socket says 172.21.15.160:59588) 2022-03-21T13:54:34.405 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa8affd700 1 -- 172.21.15.160:0/1460966432 learned_addr learned my addr 172.21.15.160:0/1460966432 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:34.406 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa8b7fe700 1 -- 172.21.15.160:0/1460966432 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8c05dc80 msgr2=0x7ffa8c158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.406 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa827fc700 1 --2- 172.21.15.160:0/1460966432 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8c05dc80 0x7ffa8c158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.406 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa8b7fe700 1 --2- 172.21.15.160:0/1460966432 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8c05dc80 0x7ffa8c158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.407 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa8a7fc700 1 -- 172.21.15.160:0/1460966432 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998800294 0 0) 0x7ffa8c1558b0 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.407 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa8b7fe700 1 -- 172.21.15.160:0/1460966432 >> v1:172.21.15.160:6789/0 conn(0x7ffa8c14ebe0 legacy=0x7ffa8c0c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.407 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa8b7fe700 1 -- 172.21.15.160:0/1460966432 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c154a70 con 0x7ffa8c0c1f40 2022-03-21T13:54:34.408 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.393+0000 7ffa8b7fe700 1 --2- 172.21.15.160:0/1460966432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa8c0c1f40 0x7ffa8c0c23c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009e60 tx=0x7ffa84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151759930b9674c7 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.408 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.394+0000 7ffa8a7fc700 1 -- 172.21.15.160:0/1460966432 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400e070 con 0x7ffa8c0c1f40 2022-03-21T13:54:34.408 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.394+0000 7ffa8a7fc700 1 -- 172.21.15.160:0/1460966432 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8400bc30 con 0x7ffa8c0c1f40 2022-03-21T13:54:34.409 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.394+0000 7ffa8a7fc700 1 -- 172.21.15.160:0/1460966432 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa84012430 con 0x7ffa8c0c1f40 2022-03-21T13:54:34.409 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.394+0000 7ffa91a27700 1 -- 172.21.15.160:0/1460966432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa8c0c1f40 msgr2=0x7ffa8c0c23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.410 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.394+0000 7ffa91a27700 1 --2- 172.21.15.160:0/1460966432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa8c0c1f40 0x7ffa8c0c23c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009e60 tx=0x7ffa84009780 comp rx=0 tx=0).stop 2022-03-21T13:54:34.410 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.394+0000 7ffa91a27700 1 -- 172.21.15.160:0/1460966432 shutdown_connections 2022-03-21T13:54:34.410 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.394+0000 7ffa91a27700 1 --2- 172.21.15.160:0/1460966432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa8c0c1f40 0x7ffa8c0c23c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.411 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.394+0000 7ffa91a27700 1 --2- 172.21.15.160:0/1460966432 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8c05dc80 0x7ffa8c158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.411 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.394+0000 7ffa91a27700 1 -- 172.21.15.160:0/1460966432 >> 172.21.15.160:0/1460966432 conn(0x7ffa8c068310 msgr2=0x7ffa8c068710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.411 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.394+0000 7ffa91a27700 1 -- 172.21.15.160:0/1460966432 shutdown_connections 2022-03-21T13:54:34.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.394+0000 7ffa91a27700 1 -- 172.21.15.160:0/1460966432 wait complete. 2022-03-21T13:54:34.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.395+0000 7ffa91a27700 1 Processor -- start 2022-03-21T13:54:34.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.395+0000 7ffa91a27700 1 -- start start 2022-03-21T13:54:34.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa91a27700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8c05dc80 0x7ffa8c152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa91a27700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8c0c1f40 0x7ffa8c164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa91a27700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa8c14ebe0 0x7ffa8c145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa91a27700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0bf030 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa91a27700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c147330 con 0x7ffa8c05dc80 2022-03-21T13:54:34.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa91a27700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c1477c0 con 0x7ffa8c0c1f40 2022-03-21T13:54:34.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa8b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa8c14ebe0 0x7ffa8c145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa8b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa8c14ebe0 0x7ffa8c145990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56446/0 (socket says 172.21.15.160:56446) 2022-03-21T13:54:34.416 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa8b7fe700 1 -- 172.21.15.160:0/72705575 learned_addr learned my addr 172.21.15.160:0/72705575 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.416 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa827fc700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8c0c1f40 0x7ffa8c164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.416 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa8b7fe700 1 -- 172.21.15.160:0/72705575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8c0c1f40 msgr2=0x7ffa8c164680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa8affd700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8c05dc80 0x7ffa8c152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa8b7fe700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8c0c1f40 0x7ffa8c164680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa8b7fe700 1 -- 172.21.15.160:0/72705575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8c05dc80 msgr2=0x7ffa8c152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.418 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.396+0000 7ffa8b7fe700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8c05dc80 0x7ffa8c152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.418 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.397+0000 7ffa8b7fe700 1 -- 172.21.15.160:0/72705575 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa84009a20 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.418 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.397+0000 7ffa8b7fe700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa8c14ebe0 0x7ffa8c145990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa84013000 tx=0x7ffa84019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.419 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.397+0000 7ffa837fe700 1 -- 172.21.15.160:0/72705575 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa84012aa0 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.419 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.397+0000 7ffa837fe700 1 -- 172.21.15.160:0/72705575 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa84012c20 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.419 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.397+0000 7ffa91a27700 1 -- 172.21.15.160:0/72705575 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c0bea70 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.420 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.397+0000 7ffa837fe700 1 -- 172.21.15.160:0/72705575 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa84004040 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.420 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.397+0000 7ffa91a27700 1 -- 172.21.15.160:0/72705575 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c146ce0 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.420 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.398+0000 7ffa91a27700 1 -- 172.21.15.160:0/72705575 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c146b40 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.421 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.398+0000 7ffa837fe700 1 -- 172.21.15.160:0/72705575 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7ffa840043b0 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.421 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.398+0000 7ffa837fe700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ffa70063d10 0x7ffa700661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.421 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.399+0000 7ffa837fe700 1 -- 172.21.15.160:0/72705575 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffa84083470 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.422 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.399+0000 7ffa8affd700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ffa70063d10 0x7ffa700661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.422 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.399+0000 7ffa8affd700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ffa70063d10 0x7ffa700661c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c007fd0 tx=0x7ffa7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.423 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.403+0000 7ffa837fe700 1 -- 172.21.15.160:0/72705575 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7ffa8c146b40 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.577 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.575+0000 7ffa91a27700 1 -- 172.21.15.160:0/72705575 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa8c146b40 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.578 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.576+0000 7ffa837fe700 1 -- 172.21.15.160:0/72705575 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16893 (secure 0 0 0) 0x7ffa8c146b40 con 0x7ffa8c14ebe0 2022-03-21T13:54:34.579 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:34.579 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":20,"fsid":"b2a3ddc8-064e-4cc9-8187-33ea19afd50a","created":"2022-03-21T13:54:10.384226+0000","modified":"2022-03-21T13:54:28.535055+0000","last_up_change":"2022-03-21T13:54:20.412036+0000","last_in_change":"2022-03-21T13:54:12.760084+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-03-21T13:54:21.458770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-03-21T13:54:21.499620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-21T13:54:25.482900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-21T13:54:26.501704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"828ac39d-86ad-44a1-bb66-c99786642970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":25441},{"type":"v1","addr":"172.21.15.160:6810","nonce":25441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":25441},{"type":"v1","addr":"172.21.15.160:6814","nonce":25441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":25441},{"type":"v1","addr":"172.21.15.160:6822","nonce":25441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":25441},{"type":"v1","addr":"172.21.15.160:6818","nonce":25441}]},"public_addr":"172.21.15.160:6810/25441","cluster_addr":"172.21.15.160:6814/25441","heartbeat_back_addr":"172.21.15.160:6822/25441","heartbeat_front_addr":"172.21.15.160:6818/25441","state":["exists","up"]},{"osd":1,"uuid":"464764e2-a47e-43c0-8c93-b6bfd10ba526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":25442},{"type":"v1","addr":"172.21.15.160:6825","nonce":25442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":25442},{"type":"v1","addr":"172.21.15.160:6827","nonce":25442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":25442},{"type":"v1","addr":"172.21.15.160:6831","nonce":25442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":25442},{"type":"v1","addr":"172.21.15.160:6829","nonce":25442}]},"public_addr":"172.21.15.160:6825/25442","cluster_addr":"172.21.15.160:6827/25442","heartbeat_back_addr":"172.21.15.160:6831/25442","heartbeat_front_addr":"172.21.15.160:6829/25442","state":["exists","up"]},{"osd":2,"uuid":"4dbfea57-14b6-4c67-8312-fc7d71ef77a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":25443},{"type":"v1","addr":"172.21.15.160:6811","nonce":25443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6813","nonce":25443},{"type":"v1","addr":"172.21.15.160:6815","nonce":25443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":25443},{"type":"v1","addr":"172.21.15.160:6823","nonce":25443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":25443},{"type":"v1","addr":"172.21.15.160:6819","nonce":25443}]},"public_addr":"172.21.15.160:6811/25443","cluster_addr":"172.21.15.160:6815/25443","heartbeat_back_addr":"172.21.15.160:6823/25443","heartbeat_front_addr":"172.21.15.160:6819/25443","state":["exists","up"]},{"osd":3,"uuid":"c53ed58d-a1f3-4783-8677-9348a1d103f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":25440},{"type":"v1","addr":"172.21.15.160:6801","nonce":25440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":25440},{"type":"v1","addr":"172.21.15.160:6803","nonce":25440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":25440},{"type":"v1","addr":"172.21.15.160:6807","nonce":25440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":25440},{"type":"v1","addr":"172.21.15.160:6805","nonce":25440}]},"public_addr":"172.21.15.160:6801/25440","cluster_addr":"172.21.15.160:6803/25440","heartbeat_back_addr":"172.21.15.160:6807/25440","heartbeat_front_addr":"172.21.15.160:6805/25440","state":["exists","up"]},{"osd":4,"uuid":"5713dbd4-1736-4ebf-8102-e80f4db6bcc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":25559},{"type":"v1","addr":"172.21.15.171:6817","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":25559},{"type":"v1","addr":"172.21.15.171:6819","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":25559},{"type":"v1","addr":"172.21.15.171:6826","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":25559},{"type":"v1","addr":"172.21.15.171:6821","nonce":25559}]},"public_addr":"172.21.15.171:6817/25559","cluster_addr":"172.21.15.171:6819/25559","heartbeat_back_addr":"172.21.15.171:6826/25559","heartbeat_front_addr":"172.21.15.171:6821/25559","state":["exists","up"]},{"osd":5,"uuid":"dfe21128-6ae6-4662-9f47-1bbb423a2232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":25549},{"type":"v1","addr":"172.21.15.171:6801","nonce":25549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":25549},{"type":"v1","addr":"172.21.15.171:6803","nonce":25549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":25549},{"type":"v1","addr":"172.21.15.171:6807","nonce":25549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":25549},{"type":"v1","addr":"172.21.15.171:6805","nonce":25549}]},"public_addr":"172.21.15.171:6801/25549","cluster_addr":"172.21.15.171:6803/25549","heartbeat_back_addr":"172.21.15.171:6807/25549","heartbeat_front_addr":"172.21.15.171:6805/25549","state":["exists","up"]},{"osd":6,"uuid":"24a9b956-5fa1-41bf-a689-0f048b7f19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":25574},{"type":"v1","addr":"172.21.15.171:6823","nonce":25574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":25574},{"type":"v1","addr":"172.21.15.171:6827","nonce":25574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":25574},{"type":"v1","addr":"172.21.15.171:6831","nonce":25574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":25574},{"type":"v1","addr":"172.21.15.171:6829","nonce":25574}]},"public_addr":"172.21.15.171:6823/25574","cluster_addr":"172.21.15.171:6827/25574","heartbeat_back_addr":"172.21.15.171:6831/25574","heartbeat_front_addr":"172.21.15.171:6829/25574","state":["exists","up"]},{"osd":7,"uuid":"a5ab4a14-8a7b-43b8-932c-a950f81c10f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":25550},{"type":"v1","addr":"172.21.15.171:6809","nonce":25550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":25550},{"type":"v1","addr":"172.21.15.171:6811","nonce":25550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":25550},{"type":"v1","addr":"172.21.15.171:6815","nonce":25550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":25550},{"type":"v1","addr":"172.21.15.171:6813","nonce":25550}]},"public_addr":"172.21.15.171:6809/25550","cluster_addr":"172.21.15.171:6811/25550","heartbeat_back_addr":"172.21.15.171:6815/25550","heartbeat_front_addr":"172.21.15.171:6813/25550","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.888796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.906098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.896027+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.876694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954695+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.846031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.883631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-21T13:54:34.581 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 -- 172.21.15.160:0/72705575 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ffa70063d10 msgr2=0x7ffa700661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.581 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ffa70063d10 0x7ffa700661c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c007fd0 tx=0x7ffa7c009040 comp rx=0 tx=0).stop 2022-03-21T13:54:34.582 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 -- 172.21.15.160:0/72705575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa8c14ebe0 msgr2=0x7ffa8c145990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.582 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa8c14ebe0 0x7ffa8c145990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa84013000 tx=0x7ffa84019000 comp rx=0 tx=0).stop 2022-03-21T13:54:34.583 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 -- 172.21.15.160:0/72705575 shutdown_connections 2022-03-21T13:54:34.583 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ffa70063d10 0x7ffa700661c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.583 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa8c14ebe0 0x7ffa8c145990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.584 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8c05dc80 0x7ffa8c152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.584 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 --2- 172.21.15.160:0/72705575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8c0c1f40 0x7ffa8c164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.584 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 -- 172.21.15.160:0/72705575 >> 172.21.15.160:0/72705575 conn(0x7ffa8c068310 msgr2=0x7ffa8c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.585 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 -- 172.21.15.160:0/72705575 shutdown_connections 2022-03-21T13:54:34.585 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.578+0000 7ffa91a27700 1 -- 172.21.15.160:0/72705575 wait complete. 2022-03-21T13:54:34.592 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-03-21T13:54:34.593 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-03-21T13:54:34.594 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-03-21T13:54:34.595 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-03-21T13:54:34.596 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2022-03-21T13:54:34.597 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2022-03-21T13:54:34.597 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2022-03-21T13:54:34.598 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2022-03-21T13:54:34.777 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.773+0000 7fb3aa78b700 1 Processor -- start 2022-03-21T13:54:34.778 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.773+0000 7fb3aa78b700 1 -- start start 2022-03-21T13:54:34.778 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.774+0000 7fb3aa78b700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb3a40ba5f0 0x7fb3a40c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.778 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.774+0000 7fb3aa78b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb3a40c08d0 0x7fb3a40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.779 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.774+0000 7fb3aa78b700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a406a2d0 con 0x7fb3a40c0500 2022-03-21T13:54:34.779 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.774+0000 7fb3aa78b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a406c070 con 0x7fb3a40c08d0 2022-03-21T13:54:34.779 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.774+0000 7fb3aa78b700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a406a5b0 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.779 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.775+0000 7fb3a37fe700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb3a40ba5f0 0x7fb3a40c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.780 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.775+0000 7fb3a8d28700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb3a40c08d0 0x7fb3a40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.780 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.775+0000 7fb3a8d28700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb3a40c08d0 0x7fb3a40c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56454/0 (socket says 172.21.15.160:56454) 2022-03-21T13:54:34.780 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.775+0000 7fb3a8d28700 1 -- 172.21.15.160:0/3984291330 learned_addr learned my addr 172.21.15.160:0/3984291330 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.780 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.776+0000 7fb3a8d28700 1 -- 172.21.15.160:0/3984291330 >> v2:172.21.15.171:3300/0 conn(0x7fb3a40ba5f0 msgr2=0x7fb3a40c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.781 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.776+0000 7fb3a8d28700 1 --2- 172.21.15.160:0/3984291330 >> v2:172.21.15.171:3300/0 conn(0x7fb3a40ba5f0 0x7fb3a40c14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.781 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.776+0000 7fb3a8d28700 1 -- 172.21.15.160:0/3984291330 >> v1:172.21.15.171:6789/0 conn(0x7fb3a40c0500 legacy=0x7fb3a40c2930 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-03-21T13:54:34.781 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.776+0000 7fb3a8d28700 1 -- 172.21.15.160:0/3984291330 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a406a890 con 0x7fb3a40c08d0 2022-03-21T13:54:34.783 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.776+0000 7fb3a8d28700 1 --2- 172.21.15.160:0/3984291330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a40c08d0 0x7fb3a40c1a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb3a406bcc0 tx=0x7fb398009980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e9fd81885d4582 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.783 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.776+0000 7fb3a2ffd700 1 -- 172.21.15.160:0/3984291330 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39800c6b0 con 0x7fb3a40c08d0 2022-03-21T13:54:34.783 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.776+0000 7fb3a2ffd700 1 -- 172.21.15.160:0/3984291330 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39800c810 con 0x7fb3a40c08d0 2022-03-21T13:54:34.784 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.776+0000 7fb3a2ffd700 1 -- 172.21.15.160:0/3984291330 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39800cbd0 con 0x7fb3a40c08d0 2022-03-21T13:54:34.784 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.777+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3984291330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a40c08d0 msgr2=0x7fb3a40c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.784 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.777+0000 7fb3aa78b700 1 --2- 172.21.15.160:0/3984291330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a40c08d0 0x7fb3a40c1a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb3a406bcc0 tx=0x7fb398009980 comp rx=0 tx=0).stop 2022-03-21T13:54:34.784 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.778+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3984291330 shutdown_connections 2022-03-21T13:54:34.784 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.778+0000 7fb3aa78b700 1 --2- 172.21.15.160:0/3984291330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a40c08d0 0x7fb3a40c1a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.785 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.778+0000 7fb3aa78b700 1 --2- 172.21.15.160:0/3984291330 >> v2:172.21.15.171:3300/0 conn(0x7fb3a40ba5f0 0x7fb3a40c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.785 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.778+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3984291330 >> 172.21.15.160:0/3984291330 conn(0x7fb3a4068620 msgr2=0x7fb3a40c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.785 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.778+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3984291330 shutdown_connections 2022-03-21T13:54:34.785 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.778+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3984291330 wait complete. 2022-03-21T13:54:34.786 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.780+0000 7fb3aa78b700 1 Processor -- start 2022-03-21T13:54:34.786 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.780+0000 7fb3aa78b700 1 -- start start 2022-03-21T13:54:34.786 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.781+0000 7fb3aa78b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a40ba5f0 0x7fb3a4175530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.786 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.781+0000 7fb3aa78b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3a40c0500 0x7fb3a41684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.787 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.781+0000 7fb3aa78b700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3a40c08d0 0x7fb3a4163d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.787 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.781+0000 7fb3aa78b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a4175a70 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.787 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.781+0000 7fb3aa78b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a41635c0 con 0x7fb3a40c0500 2022-03-21T13:54:34.787 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.781+0000 7fb3aa78b700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a41629b0 con 0x7fb3a40c08d0 2022-03-21T13:54:34.787 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.781+0000 7fb3a3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a40ba5f0 0x7fb3a4175530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.788 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.781+0000 7fb3a3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a40ba5f0 0x7fb3a4175530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56460/0 (socket says 172.21.15.160:56460) 2022-03-21T13:54:34.788 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.782+0000 7fb3a3fff700 1 -- 172.21.15.160:0/3861795181 learned_addr learned my addr 172.21.15.160:0/3861795181 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.790 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.782+0000 7fb3a3fff700 1 -- 172.21.15.160:0/3861795181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3a40c08d0 msgr2=0x7fb3a4163d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.790 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.782+0000 7fb3a3fff700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3a40c08d0 0x7fb3a4163d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.790 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.782+0000 7fb3a3fff700 1 -- 172.21.15.160:0/3861795181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3a40c0500 msgr2=0x7fb3a41684e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-03-21T13:54:34.790 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.782+0000 7fb3a3fff700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3a40c0500 0x7fb3a41684e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.791 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.782+0000 7fb3a3fff700 1 -- 172.21.15.160:0/3861795181 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb398009c00 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.791 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.783+0000 7fb3a3fff700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a40ba5f0 0x7fb3a4175530 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb39400b490 tx=0x7fb394009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.791 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.783+0000 7fb38bfff700 1 -- 172.21.15.160:0/3861795181 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394011630 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.791 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.783+0000 7fb38bfff700 1 -- 172.21.15.160:0/3861795181 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3940117b0 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.792 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.783+0000 7fb38bfff700 1 -- 172.21.15.160:0/3861795181 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394011b70 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.792 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.783+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3861795181 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a4162c90 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.792 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.783+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3861795181 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a4163250 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.792 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.784+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3861795181 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3a4070ae0 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.793 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.786+0000 7fb38bfff700 1 -- 172.21.15.160:0/3861795181 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fb394021070 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.793 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.786+0000 7fb38bfff700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb384063ce0 0x7fb384066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.793 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.787+0000 7fb38bfff700 1 -- 172.21.15.160:0/3861795181 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb394080d20 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.793 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.787+0000 7fb38bfff700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.171:6800/25549,v1:172.21.15.171:6801/25549] conn(0x7fb38406c6b0 0x7fb38406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.794 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.787+0000 7fb38bfff700 1 -- 172.21.15.160:0/3861795181 --> [v2:172.21.15.171:6800/25549,v1:172.21.15.171:6801/25549] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb38406f170 con 0x7fb38406c6b0 2022-03-21T13:54:34.794 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.787+0000 7fb38bfff700 1 -- 172.21.15.160:0/3861795181 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb394081100 con 0x7fb3a40ba5f0 2022-03-21T13:54:34.794 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.787+0000 7fb3a8d28700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.171:6800/25549,v1:172.21.15.171:6801/25549] conn(0x7fb38406c6b0 0x7fb38406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.794 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.788+0000 7fb3a8d28700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.171:6800/25549,v1:172.21.15.171:6801/25549] conn(0x7fb38406c6b0 0x7fb38406eac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.795 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.788+0000 7fb38bfff700 1 -- 172.21.15.160:0/3861795181 <== osd.5 v2:172.21.15.171:6800/25549 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7fb38406f170 con 0x7fb38406c6b0 2022-03-21T13:54:34.795 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.789+0000 7fb3a37fe700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb384063ce0 0x7fb384066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.796 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.789+0000 7f62e58d0700 1 Processor -- start 2022-03-21T13:54:34.796 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.791+0000 7fb3a37fe700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb384063ce0 0x7fb384066190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4162520 tx=0x7fb39c0073a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.798 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.789+0000 7f62e58d0700 1 -- start start 2022-03-21T13:54:34.798 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.791+0000 7f62e58d0700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62e006d740 0x7f62e006c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.798 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.791+0000 7f62e58d0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f62e00be710 0x7f62e0068050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.799 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.791+0000 7f62e58d0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e01543b0 con 0x7f62e00c1420 2022-03-21T13:54:34.799 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.791+0000 7f62e58d0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e0154690 con 0x7f62e00be710 2022-03-21T13:54:34.799 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.791+0000 7f62e58d0700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0154970 con 0x7f62e006d740 2022-03-21T13:54:34.799 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.791+0000 7f62de7fc700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62e006d740 0x7f62e006c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.800 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.791+0000 7f62de7fc700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62e006d740 0x7f62e006c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:46864/0 (socket says 172.21.15.160:46864) 2022-03-21T13:54:34.800 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.791+0000 7f62de7fc700 1 -- 172.21.15.160:0/855144599 learned_addr learned my addr 172.21.15.160:0/855144599 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.800 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.791+0000 7f62de7fc700 1 -- 172.21.15.160:0/855144599 >> v2:172.21.15.160:3300/0 conn(0x7f62e00be710 msgr2=0x7f62e0068050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.800 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.791+0000 7f62de7fc700 1 --2- 172.21.15.160:0/855144599 >> v2:172.21.15.160:3300/0 conn(0x7f62e00be710 0x7f62e0068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.800 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.792+0000 7f62de7fc700 1 -- 172.21.15.160:0/855144599 >> v1:172.21.15.160:6789/0 conn(0x7f62e00c1420 legacy=0x7f62e00c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.801 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.792+0000 7f62de7fc700 1 -- 172.21.15.160:0/855144599 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e0154c50 con 0x7f62e006d740 2022-03-21T13:54:34.801 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.792+0000 7f62de7fc700 1 --2- 172.21.15.160:0/855144599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62e006d740 0x7f62e006c390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62d4006fd0 tx=0x7f62d40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de53c05d1fabba4 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.801 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.792+0000 7f62ddffb700 1 -- 172.21.15.160:0/855144599 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d400c710 con 0x7f62e006d740 2022-03-21T13:54:34.801 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.792+0000 7f62ddffb700 1 -- 172.21.15.160:0/855144599 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d400c890 con 0x7f62e006d740 2022-03-21T13:54:34.802 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.792+0000 7f62ddffb700 1 -- 172.21.15.160:0/855144599 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d400cc50 con 0x7f62e006d740 2022-03-21T13:54:34.802 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.793+0000 7f62e58d0700 1 -- 172.21.15.160:0/855144599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62e006d740 msgr2=0x7f62e006c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.802 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.793+0000 7f62e58d0700 1 --2- 172.21.15.160:0/855144599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62e006d740 0x7f62e006c390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62d4006fd0 tx=0x7f62d40090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.802 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.793+0000 7f62e58d0700 1 -- 172.21.15.160:0/855144599 shutdown_connections 2022-03-21T13:54:34.802 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.793+0000 7f62e58d0700 1 --2- 172.21.15.160:0/855144599 >> v2:172.21.15.160:3300/0 conn(0x7f62e00be710 0x7f62e0068050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.803 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.793+0000 7f62e58d0700 1 --2- 172.21.15.160:0/855144599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62e006d740 0x7f62e006c390 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.803 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.793+0000 7f62e58d0700 1 -- 172.21.15.160:0/855144599 >> 172.21.15.160:0/855144599 conn(0x7f62e006a980 msgr2=0x7f62e006ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.803 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.793+0000 7f62e58d0700 1 -- 172.21.15.160:0/855144599 shutdown_connections 2022-03-21T13:54:34.803 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.793+0000 7f62e58d0700 1 -- 172.21.15.160:0/855144599 wait complete. 2022-03-21T13:54:34.804 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.793+0000 7fd762333700 1 Processor -- start 2022-03-21T13:54:34.804 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.794+0000 7fd762333700 1 -- start start 2022-03-21T13:54:34.805 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7fd762333700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd75c0c7300 0x7fd75c0c2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.805 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7fd762333700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd75c0ba5f0 0x7fd75c0c0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.805 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7fd762333700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c06a2d0 con 0x7fd75c0c14c0 2022-03-21T13:54:34.805 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7fd762333700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75c06c070 con 0x7fd75c0c7300 2022-03-21T13:54:34.806 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7fd762333700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75c06a5b0 con 0x7fd75c0ba5f0 2022-03-21T13:54:34.806 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7f62e58d0700 1 Processor -- start 2022-03-21T13:54:34.807 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7f80cc3da700 1 Processor -- start 2022-03-21T13:54:34.807 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7fd75b7fe700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd75c0ba5f0 0x7fd75c0c0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.807 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7fd75b7fe700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd75c0ba5f0 0x7fd75c0c0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59412/0 (socket says 172.21.15.160:59412) 2022-03-21T13:54:34.808 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7fd75b7fe700 1 -- 172.21.15.160:0/1133976925 learned_addr learned my addr 172.21.15.160:0/1133976925 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.808 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7f80cc3da700 1 -- start start 2022-03-21T13:54:34.808 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7fd75b7fe700 1 -- 172.21.15.160:0/1133976925 >> v2:172.21.15.160:3300/0 conn(0x7fd75c0c7300 msgr2=0x7fd75c0c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.809 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7fd75b7fe700 1 --2- 172.21.15.160:0/1133976925 >> v2:172.21.15.160:3300/0 conn(0x7fd75c0c7300 0x7fd75c0c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.809 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7fd75b7fe700 1 -- 172.21.15.160:0/1133976925 >> v1:172.21.15.171:6789/0 conn(0x7fd75c0c14c0 legacy=0x7fd75c06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.809 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7fd75b7fe700 1 -- 172.21.15.160:0/1133976925 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c06a890 con 0x7fd75c0ba5f0 2022-03-21T13:54:34.810 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.795+0000 7f62e58d0700 1 -- start start 2022-03-21T13:54:34.811 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7fd75b7fe700 1 --2- 172.21.15.160:0/1133976925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75c0ba5f0 0x7fd75c0c0340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0c35f0 tx=0x7fd7500090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aae0be906686bd7 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.811 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7f62e58d0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62e006d740 0x7f62e01442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.812 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7f62e58d0700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62e00be710 0x7f62e00b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.812 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7f62e58d0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62e00c1420 0x7f62e00b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.812 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7f62e58d0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0168d10 con 0x7f62e00c1420 2022-03-21T13:54:34.812 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7f62e58d0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0167eb0 con 0x7f62e006d740 2022-03-21T13:54:34.813 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7f62e58d0700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0168190 con 0x7f62e00be710 2022-03-21T13:54:34.813 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7fd75affd700 1 -- 172.21.15.160:0/1133976925 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750004030 con 0x7fd75c0ba5f0 2022-03-21T13:54:34.813 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7fd75affd700 1 -- 172.21.15.160:0/1133976925 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7500041d0 con 0x7fd75c0ba5f0 2022-03-21T13:54:34.814 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.796+0000 7fd75affd700 1 -- 172.21.15.160:0/1133976925 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750011630 con 0x7fd75c0ba5f0 2022-03-21T13:54:34.814 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f80cc3da700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f80c406d450 0x7f80c406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.814 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f80cc3da700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f80c406a010 0x7f80c406c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.815 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f80cc3da700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c406b810 con 0x7f80c40c7890 2022-03-21T13:54:34.815 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f80cc3da700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c41597a0 con 0x7f80c406a010 2022-03-21T13:54:34.815 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f80cc3da700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c406b570 con 0x7f80c406d450 2022-03-21T13:54:34.816 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f62df7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62e00c1420 0x7f62e00b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.816 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f62df7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62e00c1420 0x7f62e00b8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56480/0 (socket says 172.21.15.160:56480) 2022-03-21T13:54:34.816 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f62df7fe700 1 -- 172.21.15.160:0/2064806030 learned_addr learned my addr 172.21.15.160:0/2064806030 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.817 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f80ca977700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f80c406a010 0x7f80c406c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.817 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f80ca977700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f80c406a010 0x7f80c406c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59420/0 (socket says 172.21.15.160:59420) 2022-03-21T13:54:34.817 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f80ca977700 1 -- 172.21.15.160:0/4183017716 learned_addr learned my addr 172.21.15.160:0/4183017716 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.818 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7fd762333700 1 -- 172.21.15.160:0/1133976925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75c0ba5f0 msgr2=0x7fd75c0c0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.818 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7fd762333700 1 --2- 172.21.15.160:0/1133976925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75c0ba5f0 0x7fd75c0c0340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0c35f0 tx=0x7fd7500090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.818 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f62df7fe700 1 -- 172.21.15.160:0/2064806030 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62e00be710 msgr2=0x7f62e00b7ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-03-21T13:54:34.819 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f62df7fe700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62e00be710 0x7f62e00b7ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.819 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f62df7fe700 1 -- 172.21.15.160:0/2064806030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62e006d740 msgr2=0x7f62e01442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.819 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f62df7fe700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62e006d740 0x7f62e01442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.819 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7f62df7fe700 1 -- 172.21.15.160:0/2064806030 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4009370 con 0x7f62e00c1420 2022-03-21T13:54:34.820 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7fd762333700 1 -- 172.21.15.160:0/1133976925 shutdown_connections 2022-03-21T13:54:34.820 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7fd762333700 1 --2- 172.21.15.160:0/1133976925 >> v2:172.21.15.160:3300/0 conn(0x7fd75c0c7300 0x7fd75c0c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.820 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7fd762333700 1 --2- 172.21.15.160:0/1133976925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75c0ba5f0 0x7fd75c0c0340 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.821 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.797+0000 7fd762333700 1 -- 172.21.15.160:0/1133976925 >> 172.21.15.160:0/1133976925 conn(0x7fd75c068620 msgr2=0x7fd75c0c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.821 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.798+0000 7f62df7fe700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62e00c1420 0x7f62e00b8420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f62d000b5e0 tx=0x7f62d0009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.821 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.798+0000 7f80ca977700 1 -- 172.21.15.160:0/4183017716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f80c406d450 msgr2=0x7f80c406c070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-03-21T13:54:34.822 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.798+0000 7f80ca977700 1 --2- 172.21.15.160:0/4183017716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f80c406d450 0x7f80c406c070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.822 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.798+0000 7f80ca977700 1 -- 172.21.15.160:0/4183017716 >> v1:172.21.15.160:6789/0 conn(0x7f80c40c7890 legacy=0x7f80c415c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.822 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.798+0000 7f80ca977700 1 -- 172.21.15.160:0/4183017716 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c4159980 con 0x7f80c406a010 2022-03-21T13:54:34.823 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.798+0000 7f62c6ffd700 1 -- 172.21.15.160:0/2064806030 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0011630 con 0x7f62e00c1420 2022-03-21T13:54:34.823 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.798+0000 7f80ca977700 1 --2- 172.21.15.160:0/4183017716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80c406a010 0x7f80c406c5b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009f20 tx=0x7f80bc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df981261f360ec2b server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.824 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.798+0000 7f62c6ffd700 1 -- 172.21.15.160:0/2064806030 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d0011790 con 0x7f62e00c1420 2022-03-21T13:54:34.824 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.798+0000 7f62c6ffd700 1 -- 172.21.15.160:0/2064806030 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0011b30 con 0x7f62e00c1420 2022-03-21T13:54:34.824 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.798+0000 7f62e58d0700 1 -- 172.21.15.160:0/2064806030 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e0168470 con 0x7f62e00c1420 2022-03-21T13:54:34.825 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.798+0000 7f62e58d0700 1 -- 172.21.15.160:0/2064806030 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e0168a30 con 0x7f62e00c1420 2022-03-21T13:54:34.825 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.799+0000 7f80c9174700 1 -- 172.21.15.160:0/4183017716 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00e070 con 0x7f80c406a010 2022-03-21T13:54:34.825 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.799+0000 7f80c9174700 1 -- 172.21.15.160:0/4183017716 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc00ba40 con 0x7f80c406a010 2022-03-21T13:54:34.826 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.799+0000 7f80c9174700 1 -- 172.21.15.160:0/4183017716 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0092e0 con 0x7f80c406a010 2022-03-21T13:54:34.826 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.799+0000 7f80cc3da700 1 -- 172.21.15.160:0/4183017716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80c406a010 msgr2=0x7f80c406c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.826 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.799+0000 7f80cc3da700 1 --2- 172.21.15.160:0/4183017716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80c406a010 0x7f80c406c5b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009f20 tx=0x7f80bc009840 comp rx=0 tx=0).stop 2022-03-21T13:54:34.827 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.800+0000 7fd762333700 1 -- 172.21.15.160:0/1133976925 shutdown_connections 2022-03-21T13:54:34.827 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.800+0000 7fd762333700 1 -- 172.21.15.160:0/1133976925 wait complete. 2022-03-21T13:54:34.828 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.800+0000 7f80cc3da700 1 -- 172.21.15.160:0/4183017716 shutdown_connections 2022-03-21T13:54:34.828 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.800+0000 7f80cc3da700 1 --2- 172.21.15.160:0/4183017716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f80c406d450 0x7f80c406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.828 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.800+0000 7f80cc3da700 1 --2- 172.21.15.160:0/4183017716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80c406a010 0x7f80c406c5b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.828 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.800+0000 7f80cc3da700 1 -- 172.21.15.160:0/4183017716 >> 172.21.15.160:0/4183017716 conn(0x7f80c4068620 msgr2=0x7f80c40c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.828 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.800+0000 7f80cc3da700 1 -- 172.21.15.160:0/4183017716 shutdown_connections 2022-03-21T13:54:34.829 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.800+0000 7f62c6ffd700 1 -- 172.21.15.160:0/2064806030 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f62d0021070 con 0x7f62e00c1420 2022-03-21T13:54:34.829 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.800+0000 7f62c6ffd700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f62cc063f90 0x7f62cc066440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.830 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.800+0000 7f62c6ffd700 1 -- 172.21.15.160:0/2064806030 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f62d0080800 con 0x7f62e00c1420 2022-03-21T13:54:34.830 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.800+0000 7f80cc3da700 1 -- 172.21.15.160:0/4183017716 wait complete. 2022-03-21T13:54:34.830 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.801+0000 7f62deffd700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f62cc063f90 0x7f62cc066440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.832 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.801+0000 7fd762333700 1 Processor -- start 2022-03-21T13:54:34.832 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.801+0000 7fd762333700 1 -- start start 2022-03-21T13:54:34.832 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7fd762333700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75c0ba5f0 0x7fd75c0baa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.832 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7fd762333700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd75c0c14c0 0x7fd75c0c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.833 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7fd762333700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd75c0c7300 0x7fd75c149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.833 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7fd762333700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0bd950 con 0x7fd75c0c14c0 2022-03-21T13:54:34.833 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7fd762333700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c160c00 con 0x7fd75c0ba5f0 2022-03-21T13:54:34.833 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7fd762333700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0bdba0 con 0x7fd75c0c7300 2022-03-21T13:54:34.833 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7fd75b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd75c0c14c0 0x7fd75c0c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.834 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fd75b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd75c0c14c0 0x7fd75c0c27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56492/0 (socket says 172.21.15.160:56492) 2022-03-21T13:54:34.834 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fd75b7fe700 1 -- 172.21.15.160:0/2572435269 learned_addr learned my addr 172.21.15.160:0/2572435269 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.834 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fd7608d0700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd75c0c7300 0x7fd75c149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.834 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fd75bfff700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75c0ba5f0 0x7fd75c0baa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.835 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.801+0000 7f62deffd700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f62cc063f90 0x7f62cc066440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62d8001b10 tx=0x7f62d8007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.835 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7f62e58d0700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:6824/25442,v1:172.21.15.160:6825/25442] conn(0x7f62bc0015f0 0x7f62bc003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.836 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7f62e58d0700 1 -- 172.21.15.160:0/2064806030 --> [v2:172.21.15.160:6824/25442,v1:172.21.15.160:6825/25442] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62bc006a10 con 0x7f62bc0015f0 2022-03-21T13:54:34.836 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7f62de7fc700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:6824/25442,v1:172.21.15.160:6825/25442] conn(0x7f62bc0015f0 0x7f62bc003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.836 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7f62de7fc700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:6824/25442,v1:172.21.15.160:6825/25442] conn(0x7f62bc0015f0 0x7f62bc003aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.837 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.801+0000 7f80cc3da700 1 Processor -- start 2022-03-21T13:54:34.837 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.802+0000 7f80cc3da700 1 -- start start 2022-03-21T13:54:34.838 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80cc3da700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f80c406a010 0x7f80c4158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.838 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80cc3da700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c406d450 0x7f80c40a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.838 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80cc3da700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80c40c7890 0x7f80c40a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.838 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80cc3da700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c40aa370 con 0x7f80c406d450 2022-03-21T13:54:34.839 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80cc3da700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c40a7900 con 0x7f80c40c7890 2022-03-21T13:54:34.839 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80cc3da700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c4172210 con 0x7f80c406a010 2022-03-21T13:54:34.839 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80ca977700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80c40c7890 0x7f80c40a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.840 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fd75b7fe700 1 -- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd75c0c7300 msgr2=0x7fd75c149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.840 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fd75b7fe700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd75c0c7300 0x7fd75c149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.840 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fd75b7fe700 1 -- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75c0ba5f0 msgr2=0x7fd75c0baa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.840 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fd75b7fe700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75c0ba5f0 0x7fd75c0baa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fd75b7fe700 1 -- 172.21.15.160:0/2572435269 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750009370 con 0x7fd75c0c14c0 2022-03-21T13:54:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fd75bfff700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75c0ba5f0 0x7fd75c0baa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:34.841 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80c9975700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c406d450 0x7f80c40a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.842 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80c9975700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c406d450 0x7f80c40a47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56496/0 (socket says 172.21.15.160:56496) 2022-03-21T13:54:34.842 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80c9975700 1 -- 172.21.15.160:0/3820150141 learned_addr learned my addr 172.21.15.160:0/3820150141 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.842 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80ca176700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f80c406a010 0x7f80c4158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.843 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fd75b7fe700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd75c0c14c0 0x7fd75c0c27f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd750004000 tx=0x7fd750016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.843 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fdc5d28b700 1 Processor -- start 2022-03-21T13:54:34.844 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80c9975700 1 -- 172.21.15.160:0/3820150141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f80c406a010 msgr2=0x7f80c4158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.844 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80c9975700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f80c406a010 0x7f80c4158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.844 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7f80c9975700 1 -- 172.21.15.160:0/3820150141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80c40c7890 msgr2=0x7f80c40a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.844 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.804+0000 7f80c9975700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80c40c7890 0x7f80c40a4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.845 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.804+0000 7f80c9975700 1 -- 172.21.15.160:0/3820150141 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc009ae0 con 0x7f80c406d450 2022-03-21T13:54:34.845 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.803+0000 7fdc5d28b700 1 -- start start 2022-03-21T13:54:34.846 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.804+0000 7f80c9975700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c406d450 0x7f80c40a47c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f80c000b4c0 tx=0x7f80c0006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.846 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.804+0000 7f80b27fc700 1 -- 172.21.15.160:0/3820150141 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0010590 con 0x7f80c406d450 2022-03-21T13:54:34.847 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.804+0000 7f80b27fc700 1 -- 172.21.15.160:0/3820150141 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c00106f0 con 0x7f80c406d450 2022-03-21T13:54:34.847 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.804+0000 7f80cc3da700 1 -- 172.21.15.160:0/3820150141 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c41724b0 con 0x7f80c406d450 2022-03-21T13:54:34.847 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.804+0000 7f80b27fc700 1 -- 172.21.15.160:0/3820150141 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0010ab0 con 0x7f80c406d450 2022-03-21T13:54:34.847 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.804+0000 7f80cc3da700 1 -- 172.21.15.160:0/3820150141 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c40a63c0 con 0x7f80c406d450 2022-03-21T13:54:34.848 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7f80cc3da700 1 -- 172.21.15.160:0/3820150141 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f80a8000fd0 con 0x7f80c406d450 2022-03-21T13:54:34.848 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fd743fff700 1 -- 172.21.15.160:0/2572435269 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7500036f0 con 0x7fd75c0c14c0 2022-03-21T13:54:34.849 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fd743fff700 1 -- 172.21.15.160:0/2572435269 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd750003870 con 0x7fd75c0c14c0 2022-03-21T13:54:34.849 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fd743fff700 1 -- 172.21.15.160:0/2572435269 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750003c30 con 0x7fd75c0c14c0 2022-03-21T13:54:34.849 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fd762333700 1 -- 172.21.15.160:0/2572435269 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c0bde80 con 0x7fd75c0c14c0 2022-03-21T13:54:34.849 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fd762333700 1 -- 172.21.15.160:0/2572435269 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c160890 con 0x7fd75c0c14c0 2022-03-21T13:54:34.850 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fdc5d28b700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdc580c0500 0x7fdc580c2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.851 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fdc5d28b700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc580ba5f0 0x7fdc580c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.851 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fdc5d28b700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5806a2d0 con 0x7fdc580c08d0 2022-03-21T13:54:34.851 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fdc5d28b700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5806c070 con 0x7fdc580c0500 2022-03-21T13:54:34.851 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fdc5d28b700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5806a5b0 con 0x7fdc580ba5f0 2022-03-21T13:54:34.852 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fdc56ffd700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdc580c0500 0x7fdc580c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.852 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fdc56ffd700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdc580c0500 0x7fdc580c2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59440/0 (socket says 172.21.15.160:59440) 2022-03-21T13:54:34.852 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.805+0000 7fdc56ffd700 1 -- 172.21.15.160:0/3031394138 learned_addr learned my addr 172.21.15.160:0/3031394138 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.852 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.806+0000 7fdc56ffd700 1 -- 172.21.15.160:0/3031394138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc580ba5f0 msgr2=0x7fdc580c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.852 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.806+0000 7fdc56ffd700 1 --2- 172.21.15.160:0/3031394138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc580ba5f0 0x7fdc580c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.853 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.806+0000 7fdc56ffd700 1 -- 172.21.15.160:0/3031394138 >> v1:172.21.15.171:6789/0 conn(0x7fdc580c08d0 legacy=0x7fdc5806ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.853 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.806+0000 7fdc56ffd700 1 -- 172.21.15.160:0/3031394138 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5806a890 con 0x7fdc580c0500 2022-03-21T13:54:34.853 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.806+0000 7fdc56ffd700 1 --2- 172.21.15.160:0/3031394138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc580c0500 0x7fdc580c2930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc48006fd0 tx=0x7fdc48009980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7194753fcd0aed server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.854 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.806+0000 7fd762333700 1 -- 172.21.15.160:0/2572435269 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd75c070ae0 con 0x7fd75c0c14c0 2022-03-21T13:54:34.854 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.806+0000 7f80b27fc700 1 -- 172.21.15.160:0/3820150141 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f80c000f050 con 0x7f80c406d450 2022-03-21T13:54:34.855 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.806+0000 7fdc55ffb700 1 -- 172.21.15.160:0/3031394138 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800f750 con 0x7fdc580c0500 2022-03-21T13:54:34.855 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.807+0000 7f80b27fc700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f80a4063d10 0x7f80a40661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.856 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.807+0000 7f80b27fc700 1 -- 172.21.15.160:0/3820150141 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f80c0080c20 con 0x7f80c406d450 2022-03-21T13:54:34.856 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.807+0000 7f80b27fc700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:6800/25440,v1:172.21.15.160:6801/25440] conn(0x7f80a406c6e0 0x7f80a406eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.856 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.807+0000 7f80b27fc700 1 -- 172.21.15.160:0/3820150141 --> [v2:172.21.15.160:6800/25440,v1:172.21.15.160:6801/25440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80a406f1a0 con 0x7f80a406c6e0 2022-03-21T13:54:34.856 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.807+0000 7f80b27fc700 1 -- 172.21.15.160:0/3820150141 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80c0081000 con 0x7f80c406d450 2022-03-21T13:54:34.857 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.807+0000 7fd743fff700 1 -- 172.21.15.160:0/2572435269 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fd75002b030 con 0x7fd75c0c14c0 2022-03-21T13:54:34.857 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.808+0000 7fd743fff700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd73c063db0 0x7fd73c066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.858 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.808+0000 7fd75bfff700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd73c063db0 0x7fd73c066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.858 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.808+0000 7fd743fff700 1 -- 172.21.15.160:0/2572435269 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd7500828f0 con 0x7fd75c0c14c0 2022-03-21T13:54:34.858 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.806+0000 7fdc55ffb700 1 -- 172.21.15.160:0/3031394138 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4800f8b0 con 0x7fdc580c0500 2022-03-21T13:54:34.859 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.807+0000 7fdc55ffb700 1 -- 172.21.15.160:0/3031394138 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800fc70 con 0x7fdc580c0500 2022-03-21T13:54:34.859 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.808+0000 7fdc5d28b700 1 -- 172.21.15.160:0/3031394138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc580c0500 msgr2=0x7fdc580c2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.859 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.808+0000 7fdc5d28b700 1 --2- 172.21.15.160:0/3031394138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc580c0500 0x7fdc580c2930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc48006fd0 tx=0x7fdc48009980 comp rx=0 tx=0).stop 2022-03-21T13:54:34.859 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.809+0000 7fdc5d28b700 1 -- 172.21.15.160:0/3031394138 shutdown_connections 2022-03-21T13:54:34.859 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.809+0000 7fdc5d28b700 1 --2- 172.21.15.160:0/3031394138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc580c0500 0x7fdc580c2930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.860 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.809+0000 7fdc5d28b700 1 --2- 172.21.15.160:0/3031394138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc580ba5f0 0x7fdc580c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.860 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.809+0000 7fdc5d28b700 1 -- 172.21.15.160:0/3031394138 >> 172.21.15.160:0/3031394138 conn(0x7fdc58068620 msgr2=0x7fdc580c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.860 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.809+0000 7f62c6ffd700 1 -- 172.21.15.160:0/2064806030 <== osd.1 v2:172.21.15.160:6824/25442 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f62bc006a10 con 0x7f62bc0015f0 2022-03-21T13:54:34.861 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.808+0000 7f80ca176700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f80a4063d10 0x7f80a40661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.861 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.808+0000 7f80ca176700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f80a4063d10 0x7f80a40661c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f80b400b870 tx=0x7f80b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.861 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.808+0000 7f80ca977700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:6800/25440,v1:172.21.15.160:6801/25440] conn(0x7f80a406c6e0 0x7f80a406eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.862 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.808+0000 7fd743fff700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:6816/25559,v1:172.21.15.171:6817/25559] conn(0x7fd73c06c780 0x7fd73c06eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.862 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.808+0000 7fd743fff700 1 -- 172.21.15.160:0/2572435269 --> [v2:172.21.15.171:6816/25559,v1:172.21.15.171:6817/25559] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd73c06f240 con 0x7fd73c06c780 2022-03-21T13:54:34.862 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.808+0000 7fd743fff700 1 -- 172.21.15.160:0/2572435269 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd750082cd0 con 0x7fd75c0c14c0 2022-03-21T13:54:34.862 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.809+0000 7fd7608d0700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:6816/25559,v1:172.21.15.171:6817/25559] conn(0x7fd73c06c780 0x7fd73c06eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.863 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.809+0000 7fd75bfff700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd73c063db0 0x7fd73c066260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009990 tx=0x7fd74c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.863 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.809+0000 7f80ca977700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:6800/25440,v1:172.21.15.160:6801/25440] conn(0x7f80a406c6e0 0x7f80a406eaf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.809+0000 7fd7608d0700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:6816/25559,v1:172.21.15.171:6817/25559] conn(0x7fd73c06c780 0x7fd73c06eb90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.809+0000 7f80b27fc700 1 -- 172.21.15.160:0/3820150141 <== osd.3 v2:172.21.15.160:6800/25440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f80a406f1a0 con 0x7f80a406c6e0 2022-03-21T13:54:34.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.810+0000 7fd743fff700 1 -- 172.21.15.160:0/2572435269 <== osd.4 v2:172.21.15.171:6816/25559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7fd73c06f240 con 0x7fd73c06c780 2022-03-21T13:54:34.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.811+0000 7fdc5d28b700 1 -- 172.21.15.160:0/3031394138 shutdown_connections 2022-03-21T13:54:34.866 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.811+0000 7fdc5d28b700 1 -- 172.21.15.160:0/3031394138 wait complete. 2022-03-21T13:54:34.866 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.813+0000 7fdc5d28b700 1 Processor -- start 2022-03-21T13:54:34.866 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.813+0000 7fdc5d28b700 1 -- start start 2022-03-21T13:54:34.866 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.814+0000 7fdc5d28b700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc580ba5f0 0x7fdc58142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.867 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.814+0000 7f92dbe61700 1 Processor -- start 2022-03-21T13:54:34.867 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.814+0000 7fdc5d28b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc580c0500 0x7fdc58142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.868 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.814+0000 7fdc5d28b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc580c08d0 0x7fdc58168b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.868 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.814+0000 7fdc5d28b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580bd750 con 0x7fdc580c08d0 2022-03-21T13:54:34.868 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.814+0000 7fdc5d28b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5816ccc0 con 0x7fdc580c0500 2022-03-21T13:54:34.868 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.814+0000 7fdc5d28b700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc58145330 con 0x7fdc580ba5f0 2022-03-21T13:54:34.869 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.814+0000 7ff149acb700 1 Processor -- start 2022-03-21T13:54:34.869 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.814+0000 7f92dbe61700 1 -- start start 2022-03-21T13:54:34.870 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.814+0000 7fdc56ffd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc580ba5f0 0x7fdc58142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.871 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc567fc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc580c0500 0x7fdc58142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.871 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc56ffd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc580ba5f0 0x7fdc58142980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:46912/0 (socket says 172.21.15.160:46912) 2022-03-21T13:54:34.871 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc56ffd700 1 -- 172.21.15.160:0/1739446917 learned_addr learned my addr 172.21.15.160:0/1739446917 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.871 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc577fe700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc580c08d0 0x7fdc58168b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc56ffd700 1 -- 172.21.15.160:0/1739446917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc580c0500 msgr2=0x7fdc58142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc56ffd700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc580c0500 0x7fdc58142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc56ffd700 1 -- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc580c08d0 msgr2=0x7fdc58168b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc56ffd700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc580c08d0 0x7fdc58168b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.873 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc56ffd700 1 -- 172.21.15.160:0/1739446917 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48009c00 con 0x7fdc580ba5f0 2022-03-21T13:54:34.873 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc56ffd700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc580ba5f0 0x7fdc58142980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdc5805e4b0 tx=0x7fdc48019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7f92dbe61700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f92d40c1d40 0x7f92d4067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7f92dbe61700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d40c3750 con 0x7f92d40c23e0 2022-03-21T13:54:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7f92dbe61700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d40c2190 con 0x7f92d406c070 2022-03-21T13:54:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7f92dbe61700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d40c27b0 con 0x7f92d40c1d40 2022-03-21T13:54:34.875 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.814+0000 7ff149acb700 1 -- start start 2022-03-21T13:54:34.875 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7ff149acb700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440ba5f0 0x7ff1440c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7ff149acb700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff1440c08d0 0x7ff1440c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7ff149acb700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14406a2d0 con 0x7ff1440c0500 2022-03-21T13:54:34.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7ff149acb700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14406c070 con 0x7ff1440c08d0 2022-03-21T13:54:34.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7ff149acb700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14406a5b0 con 0x7ff1440ba5f0 2022-03-21T13:54:34.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7ff142ffd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440ba5f0 0x7ff1440c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7ff142ffd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440ba5f0 0x7ff1440c14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:46922/0 (socket says 172.21.15.160:46922) 2022-03-21T13:54:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7ff142ffd700 1 -- 172.21.15.160:0/3707423257 learned_addr learned my addr 172.21.15.160:0/3707423257 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7f92da3fe700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f92d406c070 0x7f92d40c0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:52770/0 (socket says 172.21.15.160:52770) 2022-03-21T13:54:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7f92da3fe700 1 -- 172.21.15.160:0/1553715738 learned_addr learned my addr 172.21.15.160:0/1553715738 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc3effd700 1 -- 172.21.15.160:0/1739446917 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480036f0 con 0x7fdc580ba5f0 2022-03-21T13:54:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc3effd700 1 -- 172.21.15.160:0/1739446917 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc48003850 con 0x7fdc580ba5f0 2022-03-21T13:54:34.879 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.815+0000 7fdc3effd700 1 -- 172.21.15.160:0/1739446917 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48003bf0 con 0x7fdc580ba5f0 2022-03-21T13:54:34.879 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7fdc5d28b700 1 -- 172.21.15.160:0/1739446917 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5815a760 con 0x7fdc580ba5f0 2022-03-21T13:54:34.879 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7fdc5d28b700 1 -- 172.21.15.160:0/1739446917 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5814c160 con 0x7fdc580ba5f0 2022-03-21T13:54:34.879 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.819+0000 7fdc3effd700 1 -- 172.21.15.160:0/1739446917 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fdc4802b460 con 0x7fdc580ba5f0 2022-03-21T13:54:34.880 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.819+0000 7fdc3effd700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fdc38063d60 0x7fdc38066210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.880 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.819+0000 7fdc5d28b700 1 -- 172.21.15.160:0/1739446917 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc58070ae0 con 0x7fdc580ba5f0 2022-03-21T13:54:34.880 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.819+0000 7fdc3effd700 1 -- 172.21.15.160:0/1739446917 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdc48013070 con 0x7fdc580ba5f0 2022-03-21T13:54:34.880 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.820+0000 7fdc3effd700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:6808/25441,v1:172.21.15.160:6810/25441] conn(0x7fdc3806c6b0 0x7fdc3806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.880 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.820+0000 7fdc567fc700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fdc38063d60 0x7fdc38066210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.881 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.820+0000 7fdc3effd700 1 -- 172.21.15.160:0/1739446917 --> [v2:172.21.15.160:6808/25441,v1:172.21.15.160:6810/25441] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc3806f170 con 0x7fdc3806c6b0 2022-03-21T13:54:34.881 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.820+0000 7fdc3effd700 1 -- 172.21.15.160:0/1739446917 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc480512b0 con 0x7fdc580ba5f0 2022-03-21T13:54:34.881 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.820+0000 7fdc577fe700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:6808/25441,v1:172.21.15.160:6810/25441] conn(0x7fdc3806c6b0 0x7fdc3806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.881 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.820+0000 7fdc567fc700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fdc38063d60 0x7fdc38066210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc581435a0 tx=0x7fdc4c006f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.881 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.821+0000 7fdc577fe700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:6808/25441,v1:172.21.15.160:6810/25441] conn(0x7fdc3806c6b0 0x7fdc3806eac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.882 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.822+0000 7fdc3effd700 1 -- 172.21.15.160:0/1739446917 <== osd.0 v2:172.21.15.160:6808/25441 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7fdc3806f170 con 0x7fdc3806c6b0 2022-03-21T13:54:34.882 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7ff142ffd700 1 -- 172.21.15.160:0/3707423257 >> v2:172.21.15.160:3300/0 conn(0x7ff1440c08d0 msgr2=0x7ff1440c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.882 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7ff142ffd700 1 --2- 172.21.15.160:0/3707423257 >> v2:172.21.15.160:3300/0 conn(0x7ff1440c08d0 0x7ff1440c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.883 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7ff142ffd700 1 -- 172.21.15.160:0/3707423257 >> v1:172.21.15.171:6789/0 conn(0x7ff1440c0500 legacy=0x7ff1440c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.883 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7ff142ffd700 1 -- 172.21.15.160:0/3707423257 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14406a890 con 0x7ff1440ba5f0 2022-03-21T13:54:34.883 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7ff142ffd700 1 --2- 172.21.15.160:0/3707423257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440ba5f0 0x7ff1440c14c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff134006fd0 tx=0x7ff134008190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d16c2577e072a3fe server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.884 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.823+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3861795181 --> [v2:172.21.15.171:6800/25549,v1:172.21.15.171:6801/25549] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb3a40c15a0 con 0x7fb38406c6b0 2022-03-21T13:54:34.884 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179736137 0 0) 0x7f92d40c2190 con 0x7f92d406c070 2022-03-21T13:54:34.884 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.816+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92bc0033f0 con 0x7f92d406c070 2022-03-21T13:54:34.885 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3544398131 0 0) 0x7f92bc0033f0 con 0x7f92d406c070 2022-03-21T13:54:34.885 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 >> v2:172.21.15.160:3300/0 conn(0x7f92d40c1d40 msgr2=0x7f92d4067fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.885 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 --2- 172.21.15.160:0/1553715738 >> v2:172.21.15.160:3300/0 conn(0x7f92d40c1d40 0x7f92d4067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.885 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 >> v1:172.21.15.160:6789/0 conn(0x7f92d40c23e0 legacy=0x7f92d405dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.885 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d4069310 con 0x7f92d406c070 2022-03-21T13:54:34.886 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7f92d0001470 con 0x7f92d406c070 2022-03-21T13:54:34.886 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 >> v1:172.21.15.171:6789/0 conn(0x7f92d406c070 legacy=0x7f92d40c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.886 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92bc003960 0x7f92bc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.886 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92bc004690 0x7f92bc004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.887 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92bc005240 0x7f92bc00b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.887 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40c27b0 con 0x7f92bc003960 2022-03-21T13:54:34.887 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc00c140 con 0x7f92bc004690 2022-03-21T13:54:34.887 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc00c300 con 0x7f92bc005240 2022-03-21T13:54:34.888 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d9bfd700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92bc003960 0x7f92bc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.888 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d93fc700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92bc004690 0x7f92bc004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.888 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92da3fe700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92bc005240 0x7f92bc00b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.888 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d93fc700 1 -- 172.21.15.160:0/1553715738 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92bc005240 msgr2=0x7f92bc00b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.889 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d93fc700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92bc005240 0x7f92bc00b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.889 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d93fc700 1 -- 172.21.15.160:0/1553715738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92bc003960 msgr2=0x7f92bc003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.889 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d93fc700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92bc003960 0x7f92bc003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.889 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92d93fc700 1 -- 172.21.15.160:0/1553715738 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d4069310 con 0x7f92bc004690 2022-03-21T13:54:34.889 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92da3fe700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92bc005240 0x7f92bc00b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:34.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.817+0000 7f92da3fe700 1 -- 172.21.15.160:0/1553715738 reap_dead start 2022-03-21T13:54:34.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.818+0000 7f92d93fc700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92bc004690 0x7f92bc004b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009870 tx=0x7f92c4006e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51f2aea35f85806b server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.820+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4004030 con 0x7f92bc004690 2022-03-21T13:54:34.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.820+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c40041b0 con 0x7f92bc004690 2022-03-21T13:54:34.891 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.820+0000 7f92d8bfb700 1 -- 172.21.15.160:0/1553715738 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40034c0 con 0x7f92bc004690 2022-03-21T13:54:34.891 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.821+0000 7f92dbe61700 1 -- 172.21.15.160:0/1553715738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92bc004690 msgr2=0x7f92bc004b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.891 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.821+0000 7f92dbe61700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92bc004690 0x7f92bc004b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009870 tx=0x7f92c4006e50 comp rx=0 tx=0).stop 2022-03-21T13:54:34.892 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.823+0000 7ff1427fc700 1 -- 172.21.15.160:0/3707423257 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134010070 con 0x7ff1440ba5f0 2022-03-21T13:54:34.893 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.823+0000 7ff1427fc700 1 -- 172.21.15.160:0/3707423257 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134004030 con 0x7ff1440ba5f0 2022-03-21T13:54:34.893 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.823+0000 7ff1427fc700 1 -- 172.21.15.160:0/3707423257 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340043f0 con 0x7ff1440ba5f0 2022-03-21T13:54:34.893 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.824+0000 7ff149acb700 1 -- 172.21.15.160:0/3707423257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440ba5f0 msgr2=0x7ff1440c14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.893 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.824+0000 7ff149acb700 1 --2- 172.21.15.160:0/3707423257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440ba5f0 0x7ff1440c14c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff134006fd0 tx=0x7ff134008190 comp rx=0 tx=0).stop 2022-03-21T13:54:34.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.824+0000 7ff149acb700 1 -- 172.21.15.160:0/3707423257 shutdown_connections 2022-03-21T13:54:34.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.824+0000 7ff149acb700 1 --2- 172.21.15.160:0/3707423257 >> v2:172.21.15.160:3300/0 conn(0x7ff1440c08d0 0x7ff1440c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.824+0000 7ff149acb700 1 --2- 172.21.15.160:0/3707423257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440ba5f0 0x7ff1440c14c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.824+0000 7ff149acb700 1 -- 172.21.15.160:0/3707423257 >> 172.21.15.160:0/3707423257 conn(0x7ff144068620 msgr2=0x7ff1440c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.824+0000 7ff149acb700 1 -- 172.21.15.160:0/3707423257 shutdown_connections 2022-03-21T13:54:34.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.824+0000 7ff149acb700 1 -- 172.21.15.160:0/3707423257 wait complete. 2022-03-21T13:54:34.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.824+0000 7f92dbe61700 1 -- 172.21.15.160:0/1553715738 shutdown_connections 2022-03-21T13:54:34.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.824+0000 7f92dbe61700 1 --2- 172.21.15.160:0/1553715738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92bc004690 0x7f92bc004b00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.824+0000 7f92dbe61700 1 -- 172.21.15.160:0/1553715738 >> 172.21.15.160:0/1553715738 conn(0x7f92d40c7f60 msgr2=0x7f92d40c3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.825+0000 7fb38bfff700 1 -- 172.21.15.160:0/3861795181 <== osd.5 v2:172.21.15.171:6800/25549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb3a40c15a0 con 0x7fb38406c6b0 2022-03-21T13:54:34.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.826+0000 7ff149acb700 1 Processor -- start 2022-03-21T13:54:34.898 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.826+0000 7ff149acb700 1 -- start start 2022-03-21T13:54:34.898 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff149acb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1440ba5f0 0x7ff14414d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.898 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff149acb700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440c0500 0x7ff14415b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.898 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff149acb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1440c08d0 0x7ff14414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.898 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff149acb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14414ebe0 con 0x7ff1440ba5f0 2022-03-21T13:54:34.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff149acb700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14414ddd0 con 0x7ff1440c08d0 2022-03-21T13:54:34.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff149acb700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14414ee80 con 0x7ff1440c0500 2022-03-21T13:54:34.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.827+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3861795181 >> [v2:172.21.15.171:6800/25549,v1:172.21.15.171:6801/25549] conn(0x7fb38406c6b0 msgr2=0x7fb38406eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.900 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.827+0000 7fb3aa78b700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.171:6800/25549,v1:172.21.15.171:6801/25549] conn(0x7fb38406c6b0 0x7fb38406eac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.900 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff142ffd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440c0500 0x7ff14415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.900 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff142ffd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440c0500 0x7ff14415b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:46942/0 (socket says 172.21.15.160:46942) 2022-03-21T13:54:34.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff142ffd700 1 -- 172.21.15.160:0/659676776 learned_addr learned my addr 172.21.15.160:0/659676776 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3861795181 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb384063ce0 msgr2=0x7fb384066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7fb3aa78b700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb384063ce0 0x7fb384066190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4162520 tx=0x7fb39c0073a0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3861795181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a40ba5f0 msgr2=0x7fb3a4175530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7fb3aa78b700 1 --2- 172.21.15.160:0/3861795181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a40ba5f0 0x7fb3a4175530 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb39400b490 tx=0x7fb394009060 comp rx=0 tx=0).stop 2022-03-21T13:54:34.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff1437fe700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1440ba5f0 0x7ff14414d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.903 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7fb3a8d28700 1 -- 172.21.15.160:0/3861795181 reap_dead start 2022-03-21T13:54:34.903 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3861795181 shutdown_connections 2022-03-21T13:54:34.903 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3861795181 >> 172.21.15.160:0/3861795181 conn(0x7fb3a4068620 msgr2=0x7fb3a40bef00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff142ffd700 1 -- 172.21.15.160:0/659676776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1440c08d0 msgr2=0x7ff14414cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff142ffd700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1440c08d0 0x7ff14414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff142ffd700 1 -- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1440ba5f0 msgr2=0x7ff14414d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff142ffd700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1440ba5f0 0x7ff14414d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.828+0000 7ff142ffd700 1 -- 172.21.15.160:0/659676776 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1340083f0 con 0x7ff1440c0500 2022-03-21T13:54:34.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.829+0000 7ff142ffd700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440c0500 0x7ff14415b030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff14406c1b0 tx=0x7ff13401c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.829+0000 7ff12b7fe700 1 -- 172.21.15.160:0/659676776 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134004520 con 0x7ff1440c0500 2022-03-21T13:54:34.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.829+0000 7ff12b7fe700 1 -- 172.21.15.160:0/659676776 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134000c90 con 0x7ff1440c0500 2022-03-21T13:54:34.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.829+0000 7ff12b7fe700 1 -- 172.21.15.160:0/659676776 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400b580 con 0x7ff1440c0500 2022-03-21T13:54:34.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.829+0000 7ff149acb700 1 -- 172.21.15.160:0/659676776 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14414f160 con 0x7ff1440c0500 2022-03-21T13:54:34.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.829+0000 7ff149acb700 1 -- 172.21.15.160:0/659676776 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14414f720 con 0x7ff1440c0500 2022-03-21T13:54:34.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.831+0000 7ff12b7fe700 1 -- 172.21.15.160:0/659676776 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7ff134014070 con 0x7ff1440c0500 2022-03-21T13:54:34.908 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.831+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3861795181 shutdown_connections 2022-03-21T13:54:34.908 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.831+0000 7fb3aa78b700 1 -- 172.21.15.160:0/3861795181 wait complete. 2022-03-21T13:54:34.909 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.831+0000 7ff12b7fe700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ff124063ce0 0x7ff124066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.909 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.832+0000 7ff12b7fe700 1 -- 172.21.15.160:0/659676776 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff134082060 con 0x7ff1440c0500 2022-03-21T13:54:34.909 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.832+0000 7ff1437fe700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ff124063ce0 0x7ff124066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.910 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.832+0000 7ff1437fe700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ff124063ce0 0x7ff124066190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff138001840 tx=0x7ff138009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.910 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.833+0000 7f92dbe61700 1 -- 172.21.15.160:0/1553715738 shutdown_connections 2022-03-21T13:54:34.911 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.833+0000 7ff149acb700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:6809/25443,v1:172.21.15.160:6811/25443] conn(0x7ff14414f910 0x7ff1441503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.911 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.833+0000 7ff149acb700 1 -- 172.21.15.160:0/659676776 --> [v2:172.21.15.160:6809/25443,v1:172.21.15.160:6811/25443] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff14406b4b0 con 0x7ff14414f910 2022-03-21T13:54:34.911 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.834+0000 7fd762333700 1 -- 172.21.15.160:0/2572435269 --> [v2:172.21.15.171:6816/25559,v1:172.21.15.171:6817/25559] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd75c06ac40 con 0x7fd73c06c780 2022-03-21T13:54:34.912 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.834+0000 7ff143fff700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:6809/25443,v1:172.21.15.160:6811/25443] conn(0x7ff14414f910 0x7ff1441503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.912 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.834+0000 7f92dbe61700 1 -- 172.21.15.160:0/1553715738 wait complete. 2022-03-21T13:54:34.913 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.834+0000 7ff143fff700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:6809/25443,v1:172.21.15.160:6811/25443] conn(0x7ff14414f910 0x7ff1441503b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.913 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.835+0000 7fd743fff700 1 -- 172.21.15.160:0/2572435269 <== osd.4 v2:172.21.15.171:6816/25559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd75c06ac40 con 0x7fd73c06c780 2022-03-21T13:54:34.914 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.836+0000 7f92dbe61700 1 Processor -- start 2022-03-21T13:54:34.915 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.836+0000 7f92dbe61700 1 -- start start 2022-03-21T13:54:34.915 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.837+0000 7f92dbe61700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92bc004690 0x7f92d4145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.915 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.837+0000 7f92dbe61700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92d40bb2a0 0x7f92d40bb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.915 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.837+0000 7f92dbe61700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92d40b7da0 0x7f92d40b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.915 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.837+0000 7f92dbe61700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40bbc30 con 0x7f92d40bb2a0 2022-03-21T13:54:34.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.837+0000 7f92dbe61700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40bd8e0 con 0x7f92d40b7da0 2022-03-21T13:54:34.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.837+0000 7f92dbe61700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d41469d0 con 0x7f92bc004690 2022-03-21T13:54:34.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.837+0000 7f92d93fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92d40bb2a0 0x7f92d40bb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.837+0000 7f92d93fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92d40bb2a0 0x7f92d40bb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56556/0 (socket says 172.21.15.160:56556) 2022-03-21T13:54:34.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.837+0000 7f92d93fc700 1 -- 172.21.15.160:0/643758025 learned_addr learned my addr 172.21.15.160:0/643758025 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.917 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.837+0000 7f92d9bfd700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92bc004690 0x7f92d4145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.917 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.837+0000 7f80cc3da700 1 -- 172.21.15.160:0/3820150141 --> [v2:172.21.15.160:6800/25440,v1:172.21.15.160:6801/25440] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f80a8002bb0 con 0x7f80a406c6e0 2022-03-21T13:54:34.918 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f92d93fc700 1 -- 172.21.15.160:0/643758025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92bc004690 msgr2=0x7f92d4145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.918 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f92d93fc700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92bc004690 0x7f92d4145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.918 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f92d93fc700 1 -- 172.21.15.160:0/643758025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92d40b7da0 msgr2=0x7f92d40b8210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-03-21T13:54:34.919 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f92d93fc700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92d40b7da0 0x7f92d40b8210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.919 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f92d93fc700 1 -- 172.21.15.160:0/643758025 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40c54a0 con 0x7f92d40bb2a0 2022-03-21T13:54:34.919 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f92d93fc700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92d40bb2a0 0x7f92d40bb6f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92c4006ed0 tx=0x7f92c4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.919 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f80b27fc700 1 -- 172.21.15.160:0/3820150141 <== osd.3 v2:172.21.15.160:6800/25440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f80a8002bb0 con 0x7f80a406c6e0 2022-03-21T13:54:34.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f92c1ffb700 1 -- 172.21.15.160:0/643758025 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c401d800 con 0x7f92d40bb2a0 2022-03-21T13:54:34.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f92c1ffb700 1 -- 172.21.15.160:0/643758025 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c401d960 con 0x7f92d40bb2a0 2022-03-21T13:54:34.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f92c1ffb700 1 -- 172.21.15.160:0/643758025 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c401dd20 con 0x7f92d40bb2a0 2022-03-21T13:54:34.921 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f92dbe61700 1 -- 172.21.15.160:0/643758025 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d4143320 con 0x7f92d40bb2a0 2022-03-21T13:54:34.921 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.838+0000 7f92dbe61700 1 -- 172.21.15.160:0/643758025 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d40bd290 con 0x7f92d40bb2a0 2022-03-21T13:54:34.922 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.839+0000 7fd762333700 1 -- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:6816/25559,v1:172.21.15.171:6817/25559] conn(0x7fd73c06c780 msgr2=0x7fd73c06eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.922 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.839+0000 7fd762333700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.171:6816/25559,v1:172.21.15.171:6817/25559] conn(0x7fd73c06c780 0x7fd73c06eb90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.923 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.839+0000 7f92dbe61700 1 -- 172.21.15.160:0/643758025 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f92d406fc00 con 0x7f92d40bb2a0 2022-03-21T13:54:34.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.839+0000 7fd762333700 1 -- 172.21.15.160:0/2572435269 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd73c063db0 msgr2=0x7fd73c066260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.839+0000 7fd762333700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd73c063db0 0x7fd73c066260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009990 tx=0x7fd74c008040 comp rx=0 tx=0).stop 2022-03-21T13:54:34.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.839+0000 7fd762333700 1 -- 172.21.15.160:0/2572435269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd75c0c14c0 msgr2=0x7fd75c0c27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.839+0000 7fd762333700 1 --2- 172.21.15.160:0/2572435269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd75c0c14c0 0x7fd75c0c27f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd750004000 tx=0x7fd750016000 comp rx=0 tx=0).stop 2022-03-21T13:54:34.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.839+0000 7fd7608d0700 1 -- 172.21.15.160:0/2572435269 reap_dead start 2022-03-21T13:54:34.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.841+0000 7fd762333700 1 -- 172.21.15.160:0/2572435269 shutdown_connections 2022-03-21T13:54:34.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.841+0000 7fd762333700 1 -- 172.21.15.160:0/2572435269 >> 172.21.15.160:0/2572435269 conn(0x7fd75c068620 msgr2=0x7fd75c0c4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.841+0000 7fd762333700 1 -- 172.21.15.160:0/2572435269 shutdown_connections 2022-03-21T13:54:34.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.841+0000 7fd762333700 1 -- 172.21.15.160:0/2572435269 wait complete. 2022-03-21T13:54:34.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.841+0000 7f62e58d0700 1 -- 172.21.15.160:0/2064806030 --> [v2:172.21.15.160:6824/25442,v1:172.21.15.160:6825/25442] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62bc005aa0 con 0x7f62bc0015f0 2022-03-21T13:54:34.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.841+0000 7f92c1ffb700 1 -- 172.21.15.160:0/643758025 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f92c402d070 con 0x7f92d40bb2a0 2022-03-21T13:54:34.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.841+0000 7f92c1ffb700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f92b4063d30 0x7f92b40661e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.842+0000 7f92c1ffb700 1 -- 172.21.15.160:0/643758025 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f92c4082270 con 0x7f92d40bb2a0 2022-03-21T13:54:34.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.842+0000 7f92c1ffb700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.171:6822/25574,v1:172.21.15.171:6823/25574] conn(0x7f92b406c700 0x7f92b406eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.842+0000 7f92c1ffb700 1 -- 172.21.15.160:0/643758025 --> [v2:172.21.15.171:6822/25574,v1:172.21.15.171:6823/25574] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92b406f1c0 con 0x7f92b406c700 2022-03-21T13:54:34.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.842+0000 7f92c1ffb700 1 -- 172.21.15.160:0/643758025 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92c40825a0 con 0x7f92d40bb2a0 2022-03-21T13:54:34.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.842+0000 7f92d9bfd700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f92b4063d30 0x7f92b40661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.842+0000 7ff12b7fe700 1 -- 172.21.15.160:0/659676776 <== osd.2 v2:172.21.15.160:6809/25443 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7ff14406b4b0 con 0x7ff14414f910 2022-03-21T13:54:34.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.842+0000 7ffab9010700 1 Processor -- start 2022-03-21T13:54:34.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.842+0000 7f92da3fe700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.171:6822/25574,v1:172.21.15.171:6823/25574] conn(0x7f92b406c700 0x7f92b406eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.842+0000 7ffab9010700 1 -- start start 2022-03-21T13:54:34.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.842+0000 7f62c6ffd700 1 -- 172.21.15.160:0/2064806030 <== osd.1 v2:172.21.15.160:6824/25442 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f62bc005aa0 con 0x7f62bc0015f0 2022-03-21T13:54:34.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7f92da3fe700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.171:6822/25574,v1:172.21.15.171:6823/25574] conn(0x7f92b406c700 0x7f92b406eb10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7f62e58d0700 1 -- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:6824/25442,v1:172.21.15.160:6825/25442] conn(0x7f62bc0015f0 msgr2=0x7f62bc003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7f62e58d0700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:6824/25442,v1:172.21.15.160:6825/25442] conn(0x7f62bc0015f0 0x7f62bc003aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7f62e58d0700 1 -- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f62cc063f90 msgr2=0x7f62cc066440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7f62e58d0700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f62cc063f90 0x7f62cc066440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62d8001b10 tx=0x7f62d8007d00 comp rx=0 tx=0).stop 2022-03-21T13:54:34.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7f62e58d0700 1 -- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62e00c1420 msgr2=0x7f62e00b8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7f62e58d0700 1 --2- 172.21.15.160:0/2064806030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62e00c1420 0x7f62e00b8420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f62d000b5e0 tx=0x7f62d0009060 comp rx=0 tx=0).stop 2022-03-21T13:54:34.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7ffab9010700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffab40c6280 0x7ffab414f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7ffab9010700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab4067ab0 con 0x7ffab40c53e0 2022-03-21T13:54:34.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7ffab9010700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab40c3a20 con 0x7ffab414ec50 2022-03-21T13:54:34.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7ffab9010700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40c32c0 con 0x7ffab40c6280 2022-03-21T13:54:34.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7ffab359e700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffab40c6280 0x7ffab414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7ffab359e700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffab40c6280 0x7ffab414f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59502/0 (socket says 172.21.15.160:59502) 2022-03-21T13:54:34.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7ffab359e700 1 -- 172.21.15.160:0/1703451747 learned_addr learned my addr 172.21.15.160:0/1703451747 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7f92c1ffb700 1 -- 172.21.15.160:0/643758025 <== osd.6 v2:172.21.15.171:6822/25574 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f92b406f1c0 con 0x7f92b406c700 2022-03-21T13:54:34.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.843+0000 7f62df7fe700 1 -- 172.21.15.160:0/2064806030 reap_dead start 2022-03-21T13:54:34.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.844+0000 7f92d9bfd700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f92b4063d30 0x7f92b40661e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f92cc001f90 tx=0x7f92cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.844+0000 7ffab359e700 1 -- 172.21.15.160:0/1703451747 >> v1:172.21.15.171:6789/0 conn(0x7ffab414ec50 legacy=0x7ffab406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:34.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.844+0000 7ffab359e700 1 -- 172.21.15.160:0/1703451747 >> v1:172.21.15.160:6789/0 conn(0x7ffab40c53e0 legacy=0x7ffab4154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.844+0000 7ffab359e700 1 -- 172.21.15.160:0/1703451747 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40677d0 con 0x7ffab40c6280 2022-03-21T13:54:34.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.844+0000 7f62e58d0700 1 -- 172.21.15.160:0/2064806030 shutdown_connections 2022-03-21T13:54:34.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.844+0000 7f62e58d0700 1 -- 172.21.15.160:0/2064806030 >> 172.21.15.160:0/2064806030 conn(0x7f62e006a980 msgr2=0x7f62e0152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.844+0000 7ffab359e700 1 --2- 172.21.15.160:0/1703451747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab40c6280 0x7ffab414f020 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009f20 tx=0x7ffaac009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b969e98c4b23337e server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.844+0000 7ffab1d9b700 1 -- 172.21.15.160:0/1703451747 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac00e070 con 0x7ffab40c6280 2022-03-21T13:54:34.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.844+0000 7ffab1d9b700 1 -- 172.21.15.160:0/1703451747 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac00ba40 con 0x7ffab40c6280 2022-03-21T13:54:34.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.844+0000 7ffab1d9b700 1 -- 172.21.15.160:0/1703451747 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0092e0 con 0x7ffab40c6280 2022-03-21T13:54:34.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7f80cc3da700 1 -- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:6800/25440,v1:172.21.15.160:6801/25440] conn(0x7f80a406c6e0 msgr2=0x7f80a406eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7f80cc3da700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:6800/25440,v1:172.21.15.160:6801/25440] conn(0x7f80a406c6e0 0x7f80a406eaf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7f62e58d0700 1 -- 172.21.15.160:0/2064806030 shutdown_connections 2022-03-21T13:54:34.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7f80cc3da700 1 -- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f80a4063d10 msgr2=0x7f80a40661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7f80cc3da700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f80a4063d10 0x7f80a40661c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f80b400b870 tx=0x7f80b4008040 comp rx=0 tx=0).stop 2022-03-21T13:54:34.942 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7f80cc3da700 1 -- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c406d450 msgr2=0x7f80c40a47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.942 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7f80cc3da700 1 --2- 172.21.15.160:0/3820150141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c406d450 0x7f80c40a47c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f80c000b4c0 tx=0x7f80c0006ef0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.942 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7f62e58d0700 1 -- 172.21.15.160:0/2064806030 wait complete. 2022-03-21T13:54:34.943 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7ffab9010700 1 -- 172.21.15.160:0/1703451747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab40c6280 msgr2=0x7ffab414f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.943 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7ffab9010700 1 --2- 172.21.15.160:0/1703451747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab40c6280 0x7ffab414f020 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009f20 tx=0x7ffaac009840 comp rx=0 tx=0).stop 2022-03-21T13:54:34.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7ffab9010700 1 -- 172.21.15.160:0/1703451747 shutdown_connections 2022-03-21T13:54:34.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7ffab9010700 1 --2- 172.21.15.160:0/1703451747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab40c6280 0x7ffab414f020 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7ffab9010700 1 -- 172.21.15.160:0/1703451747 >> 172.21.15.160:0/1703451747 conn(0x7ffab40c98f0 msgr2=0x7ffab40c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7ffab9010700 1 -- 172.21.15.160:0/1703451747 shutdown_connections 2022-03-21T13:54:34.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.845+0000 7ffab9010700 1 -- 172.21.15.160:0/1703451747 wait complete. 2022-03-21T13:54:34.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.846+0000 7f80ca977700 1 -- 172.21.15.160:0/3820150141 reap_dead start 2022-03-21T13:54:34.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.846+0000 7f80cc3da700 1 -- 172.21.15.160:0/3820150141 shutdown_connections 2022-03-21T13:54:34.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.846+0000 7f80cc3da700 1 -- 172.21.15.160:0/3820150141 >> 172.21.15.160:0/3820150141 conn(0x7f80c4068620 msgr2=0x7f80c40c63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.846+0000 7f80cc3da700 1 -- 172.21.15.160:0/3820150141 shutdown_connections 2022-03-21T13:54:34.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.846+0000 7f80cc3da700 1 -- 172.21.15.160:0/3820150141 wait complete. 2022-03-21T13:54:34.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.847+0000 7ffab9010700 1 Processor -- start 2022-03-21T13:54:34.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.847+0000 7ffab9010700 1 -- start start 2022-03-21T13:54:34.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab9010700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffab40c53e0 0x7ffab4154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab9010700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab40c6280 0x7ffab40be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab9010700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab414ec50 0x7ffab40bea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab9010700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab4155850 con 0x7ffab40c53e0 2022-03-21T13:54:34.950 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab9010700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab414fce0 con 0x7ffab40c6280 2022-03-21T13:54:34.950 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab9010700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40c18e0 con 0x7ffab414ec50 2022-03-21T13:54:34.950 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab2d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffab40c53e0 0x7ffab4154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.950 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab2d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffab40c53e0 0x7ffab4154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56574/0 (socket says 172.21.15.160:56574) 2022-03-21T13:54:34.951 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab2d9d700 1 -- 172.21.15.160:0/3121762208 learned_addr learned my addr 172.21.15.160:0/3121762208 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:34.951 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab259c700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab40c6280 0x7ffab40be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.951 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab259c700 1 -- 172.21.15.160:0/3121762208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab414ec50 msgr2=0x7ffab40bea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.952 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab259c700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab414ec50 0x7ffab40bea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.952 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab259c700 1 -- 172.21.15.160:0/3121762208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffab40c53e0 msgr2=0x7ffab4154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.952 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab259c700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffab40c53e0 0x7ffab4154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.952 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab259c700 1 -- 172.21.15.160:0/3121762208 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac009ae0 con 0x7ffab40c6280 2022-03-21T13:54:34.953 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.848+0000 7ffab259c700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab40c6280 0x7ffab40be4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800c470 tx=0x7ffaa8007d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.953 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.849+0000 7ffa9affd700 1 -- 172.21.15.160:0/3121762208 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800ce30 con 0x7ffab40c6280 2022-03-21T13:54:34.953 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.849+0000 7ffa9affd700 1 -- 172.21.15.160:0/3121762208 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa80050d0 con 0x7ffab40c6280 2022-03-21T13:54:34.953 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.849+0000 7ffab9010700 1 -- 172.21.15.160:0/3121762208 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab414f720 con 0x7ffab40c6280 2022-03-21T13:54:34.954 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.849+0000 7ffa9affd700 1 -- 172.21.15.160:0/3121762208 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8011590 con 0x7ffab40c6280 2022-03-21T13:54:34.954 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.849+0000 7ffab9010700 1 -- 172.21.15.160:0/3121762208 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab41554e0 con 0x7ffab40c6280 2022-03-21T13:54:34.955 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:34.956 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-03-21T13:54:34.956 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.850+0000 7ffab9010700 1 -- 172.21.15.160:0/3121762208 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffab406fc00 con 0x7ffab40c6280 2022-03-21T13:54:34.957 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.854+0000 7fdc5d28b700 1 -- 172.21.15.160:0/1739446917 --> [v2:172.21.15.160:6808/25441,v1:172.21.15.160:6810/25441] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdc5806ac40 con 0x7fdc3806c6b0 2022-03-21T13:54:34.959 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.854+0000 7ffa9affd700 1 -- 172.21.15.160:0/3121762208 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7ffaa8019030 con 0x7ffab40c6280 2022-03-21T13:54:34.959 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.854+0000 7ffa9affd700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ffa94063db0 0x7ffa94066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.959 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.854+0000 7ffa9affd700 1 -- 172.21.15.160:0/3121762208 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffaa807f8c0 con 0x7ffab40c6280 2022-03-21T13:54:34.960 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.854+0000 7ffab2d9d700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ffa94063db0 0x7ffa94066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.960 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.854+0000 7ffa9affd700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.171:6808/25550,v1:172.21.15.171:6809/25550] conn(0x7ffa9406c780 0x7ffa9406eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:34.960 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.854+0000 7ffa9affd700 1 -- 172.21.15.160:0/3121762208 --> [v2:172.21.15.171:6808/25550,v1:172.21.15.171:6809/25550] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa9406f240 con 0x7ffa9406c780 2022-03-21T13:54:34.960 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.854+0000 7ffa9affd700 1 -- 172.21.15.160:0/3121762208 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffaa8084220 con 0x7ffab40c6280 2022-03-21T13:54:34.961 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.855+0000 7ffab359e700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.171:6808/25550,v1:172.21.15.171:6809/25550] conn(0x7ffa9406c780 0x7ffa9406eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:34.961 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.855+0000 7ffab2d9d700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ffa94063db0 0x7ffa94066260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009a60 tx=0x7ffaa4006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.961 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.855+0000 7ffab359e700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.171:6808/25550,v1:172.21.15.171:6809/25550] conn(0x7ffa9406c780 0x7ffa9406eb90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:34.961 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.856+0000 7ffa9affd700 1 -- 172.21.15.160:0/3121762208 <== osd.7 v2:172.21.15.171:6808/25550 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7ffa9406f240 con 0x7ffa9406c780 2022-03-21T13:54:34.962 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:34.962 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:34.963 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-03-21T13:54:34.964 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-03-21T13:54:34.965 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc3effd700 1 -- 172.21.15.160:0/1739446917 <== osd.0 v2:172.21.15.160:6808/25441 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdc5806ac40 con 0x7fdc3806c6b0 2022-03-21T13:54:34.966 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc5d28b700 1 -- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:6808/25441,v1:172.21.15.160:6810/25441] conn(0x7fdc3806c6b0 msgr2=0x7fdc3806eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.966 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc5d28b700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:6808/25441,v1:172.21.15.160:6810/25441] conn(0x7fdc3806c6b0 0x7fdc3806eac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.966 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc5d28b700 1 -- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fdc38063d60 msgr2=0x7fdc38066210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.967 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc5d28b700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fdc38063d60 0x7fdc38066210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc581435a0 tx=0x7fdc4c006f10 comp rx=0 tx=0).stop 2022-03-21T13:54:34.967 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc5d28b700 1 -- 172.21.15.160:0/1739446917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc580ba5f0 msgr2=0x7fdc58142980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.967 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc5d28b700 1 --2- 172.21.15.160:0/1739446917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc580ba5f0 0x7fdc58142980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdc5805e4b0 tx=0x7fdc48019000 comp rx=0 tx=0).stop 2022-03-21T13:54:34.967 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc577fe700 1 -- 172.21.15.160:0/1739446917 reap_dead start 2022-03-21T13:54:34.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc5d28b700 1 -- 172.21.15.160:0/1739446917 shutdown_connections 2022-03-21T13:54:34.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc5d28b700 1 -- 172.21.15.160:0/1739446917 >> 172.21.15.160:0/1739446917 conn(0x7fdc58068620 msgr2=0x7fdc580c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc5d28b700 1 -- 172.21.15.160:0/1739446917 shutdown_connections 2022-03-21T13:54:34.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.867+0000 7fdc5d28b700 1 -- 172.21.15.160:0/1739446917 wait complete. 2022-03-21T13:54:34.969 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.869+0000 7ff149acb700 1 -- 172.21.15.160:0/659676776 --> [v2:172.21.15.160:6809/25443,v1:172.21.15.160:6811/25443] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff14406ac40 con 0x7ff14414f910 2022-03-21T13:54:34.969 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.870+0000 7ff12b7fe700 1 -- 172.21.15.160:0/659676776 <== osd.2 v2:172.21.15.160:6809/25443 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff14406ac40 con 0x7ff14414f910 2022-03-21T13:54:34.970 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:34.970 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-03-21T13:54:34.972 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.870+0000 7ff149acb700 1 -- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:6809/25443,v1:172.21.15.160:6811/25443] conn(0x7ff14414f910 msgr2=0x7ff1441503b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.972 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.870+0000 7ff149acb700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:6809/25443,v1:172.21.15.160:6811/25443] conn(0x7ff14414f910 0x7ff1441503b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.973 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.871+0000 7ff149acb700 1 -- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ff124063ce0 msgr2=0x7ff124066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.973 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.871+0000 7ff149acb700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ff124063ce0 0x7ff124066190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff138001840 tx=0x7ff138009040 comp rx=0 tx=0).stop 2022-03-21T13:54:34.973 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.871+0000 7ff149acb700 1 -- 172.21.15.160:0/659676776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440c0500 msgr2=0x7ff14415b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.973 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.871+0000 7ff149acb700 1 --2- 172.21.15.160:0/659676776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1440c0500 0x7ff14415b030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff14406c1b0 tx=0x7ff13401c000 comp rx=0 tx=0).stop 2022-03-21T13:54:34.973 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.871+0000 7ff143fff700 1 -- 172.21.15.160:0/659676776 reap_dead start 2022-03-21T13:54:34.974 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.872+0000 7ff149acb700 1 -- 172.21.15.160:0/659676776 shutdown_connections 2022-03-21T13:54:34.974 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.872+0000 7ff149acb700 1 -- 172.21.15.160:0/659676776 >> 172.21.15.160:0/659676776 conn(0x7ff144068620 msgr2=0x7ff1440c58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.974 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.872+0000 7ff149acb700 1 -- 172.21.15.160:0/659676776 shutdown_connections 2022-03-21T13:54:34.974 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.872+0000 7ff149acb700 1 -- 172.21.15.160:0/659676776 wait complete. 2022-03-21T13:54:34.975 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:34.976 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-03-21T13:54:34.976 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.880+0000 7f92dbe61700 1 -- 172.21.15.160:0/643758025 --> [v2:172.21.15.171:6822/25574,v1:172.21.15.171:6823/25574] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f92d4070210 con 0x7f92b406c700 2022-03-21T13:54:34.977 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.881+0000 7f92c1ffb700 1 -- 172.21.15.160:0/643758025 <== osd.6 v2:172.21.15.171:6822/25574 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f92d4070210 con 0x7f92b406c700 2022-03-21T13:54:34.978 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.881+0000 7f92dbe61700 1 -- 172.21.15.160:0/643758025 >> [v2:172.21.15.171:6822/25574,v1:172.21.15.171:6823/25574] conn(0x7f92b406c700 msgr2=0x7f92b406eb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.978 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.881+0000 7f92dbe61700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.171:6822/25574,v1:172.21.15.171:6823/25574] conn(0x7f92b406c700 0x7f92b406eb10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.978 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.881+0000 7f92dbe61700 1 -- 172.21.15.160:0/643758025 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f92b4063d30 msgr2=0x7f92b40661e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.881+0000 7f92dbe61700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f92b4063d30 0x7f92b40661e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f92cc001f90 tx=0x7f92cc009040 comp rx=0 tx=0).stop 2022-03-21T13:54:34.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.881+0000 7f92dbe61700 1 -- 172.21.15.160:0/643758025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92d40bb2a0 msgr2=0x7f92d40bb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.881+0000 7f92dbe61700 1 --2- 172.21.15.160:0/643758025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92d40bb2a0 0x7f92d40bb6f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92c4006ed0 tx=0x7f92c4013000 comp rx=0 tx=0).stop 2022-03-21T13:54:34.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.881+0000 7f92da3fe700 1 -- 172.21.15.160:0/643758025 reap_dead start 2022-03-21T13:54:34.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.881+0000 7f92dbe61700 1 -- 172.21.15.160:0/643758025 shutdown_connections 2022-03-21T13:54:34.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.881+0000 7f92dbe61700 1 -- 172.21.15.160:0/643758025 >> 172.21.15.160:0/643758025 conn(0x7f92d40c7f60 msgr2=0x7f92d40bfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.882+0000 7f92dbe61700 1 -- 172.21.15.160:0/643758025 shutdown_connections 2022-03-21T13:54:34.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.882+0000 7f92dbe61700 1 -- 172.21.15.160:0/643758025 wait complete. 2022-03-21T13:54:34.981 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:34.982 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-03-21T13:54:34.982 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.885+0000 7ffab9010700 1 -- 172.21.15.160:0/3121762208 --> [v2:172.21.15.171:6808/25550,v1:172.21.15.171:6809/25550] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffab406ab80 con 0x7ffa9406c780 2022-03-21T13:54:34.983 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.886+0000 7ffa9affd700 1 -- 172.21.15.160:0/3121762208 <== osd.7 v2:172.21.15.171:6808/25550 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffab406ab80 con 0x7ffa9406c780 2022-03-21T13:54:34.984 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.887+0000 7ffab9010700 1 -- 172.21.15.160:0/3121762208 >> [v2:172.21.15.171:6808/25550,v1:172.21.15.171:6809/25550] conn(0x7ffa9406c780 msgr2=0x7ffa9406eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.984 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.887+0000 7ffab9010700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.171:6808/25550,v1:172.21.15.171:6809/25550] conn(0x7ffa9406c780 0x7ffa9406eb90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:34.985 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.887+0000 7ffab9010700 1 -- 172.21.15.160:0/3121762208 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ffa94063db0 msgr2=0x7ffa94066260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.985 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.887+0000 7ffab9010700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7ffa94063db0 0x7ffa94066260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009a60 tx=0x7ffaa4006f90 comp rx=0 tx=0).stop 2022-03-21T13:54:34.985 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.887+0000 7ffab9010700 1 -- 172.21.15.160:0/3121762208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab40c6280 msgr2=0x7ffab40be4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:34.985 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.887+0000 7ffab9010700 1 --2- 172.21.15.160:0/3121762208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab40c6280 0x7ffab40be4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800c470 tx=0x7ffaa8007d40 comp rx=0 tx=0).stop 2022-03-21T13:54:34.986 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.887+0000 7ffab359e700 1 -- 172.21.15.160:0/3121762208 reap_dead start 2022-03-21T13:54:34.986 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.887+0000 7ffab9010700 1 -- 172.21.15.160:0/3121762208 shutdown_connections 2022-03-21T13:54:34.986 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.887+0000 7ffab9010700 1 -- 172.21.15.160:0/3121762208 >> 172.21.15.160:0/3121762208 conn(0x7ffab40c98f0 msgr2=0x7ffab414e540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:34.986 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.887+0000 7ffab9010700 1 -- 172.21.15.160:0/3121762208 shutdown_connections 2022-03-21T13:54:34.986 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:34.887+0000 7ffab9010700 1 -- 172.21.15.160:0/3121762208 wait complete. 2022-03-21T13:54:34.987 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:34.988 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-03-21T13:54:34.989 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:34.989 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-03-21T13:54:35.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.194+0000 7f789bb42700 1 Processor -- start 2022-03-21T13:54:35.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.194+0000 7f789bb42700 1 -- start start 2022-03-21T13:54:35.197 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.195+0000 7f789bb42700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f78940c35f0 0x7f789406c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.197 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.195+0000 7f789bb42700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f789405dc80 0x7f789406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.198 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.195+0000 7f789bb42700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78940c2250 0x7f78940b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.198 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.195+0000 7f789bb42700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789406c070 con 0x7f78940c35f0 2022-03-21T13:54:35.198 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.195+0000 7f789bb42700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78940c4640 con 0x7f789405dc80 2022-03-21T13:54:35.198 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.195+0000 7f789bb42700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940c11e0 con 0x7f78940c2250 2022-03-21T13:54:35.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.196+0000 7f789a0df700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78940c2250 0x7f78940b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.196+0000 7f789a0df700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78940c2250 0x7f78940b6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:46978/0 (socket says 172.21.15.160:46978) 2022-03-21T13:54:35.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.196+0000 7f789a0df700 1 -- 172.21.15.160:0/1045462588 learned_addr learned my addr 172.21.15.160:0/1045462588 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.200 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.196+0000 7f789a0df700 1 -- 172.21.15.160:0/1045462588 >> v2:172.21.15.171:3300/0 conn(0x7f789405dc80 msgr2=0x7f789406ca40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-03-21T13:54:35.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.196+0000 7f789a0df700 1 --2- 172.21.15.160:0/1045462588 >> v2:172.21.15.171:3300/0 conn(0x7f789405dc80 0x7f789406ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.196+0000 7f789a0df700 1 -- 172.21.15.160:0/1045462588 >> v2:172.21.15.160:3300/0 conn(0x7f78940c35f0 msgr2=0x7f789406c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:35.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.196+0000 7f789a0df700 1 --2- 172.21.15.160:0/1045462588 >> v2:172.21.15.160:3300/0 conn(0x7f78940c35f0 0x7f789406c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.196+0000 7f789a0df700 1 -- 172.21.15.160:0/1045462588 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940c4890 con 0x7f78940c2250 2022-03-21T13:54:35.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.196+0000 7f789a0df700 1 --2- 172.21.15.160:0/1045462588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78940c2250 0x7f78940b6f80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f78940c7460 tx=0x7f788c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a15b61526aba4e server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.197+0000 7f78988dc700 1 -- 172.21.15.160:0/1045462588 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c00e070 con 0x7f78940c2250 2022-03-21T13:54:35.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.197+0000 7f78988dc700 1 -- 172.21.15.160:0/1045462588 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c00ba50 con 0x7f78940c2250 2022-03-21T13:54:35.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.197+0000 7f78988dc700 1 -- 172.21.15.160:0/1045462588 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c0092e0 con 0x7f78940c2250 2022-03-21T13:54:35.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.197+0000 7f789bb42700 1 -- 172.21.15.160:0/1045462588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78940c2250 msgr2=0x7f78940b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.197+0000 7f789bb42700 1 --2- 172.21.15.160:0/1045462588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78940c2250 0x7f78940b6f80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f78940c7460 tx=0x7f788c009840 comp rx=0 tx=0).stop 2022-03-21T13:54:35.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.199+0000 7f789bb42700 1 -- 172.21.15.160:0/1045462588 shutdown_connections 2022-03-21T13:54:35.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.199+0000 7f789bb42700 1 --2- 172.21.15.160:0/1045462588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78940c2250 0x7f78940b6f80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.199+0000 7f789bb42700 1 --2- 172.21.15.160:0/1045462588 >> v2:172.21.15.160:3300/0 conn(0x7f78940c35f0 0x7f789406c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.203 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.199+0000 7f789bb42700 1 --2- 172.21.15.160:0/1045462588 >> v2:172.21.15.171:3300/0 conn(0x7f789405dc80 0x7f789406ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.204 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.199+0000 7f789bb42700 1 -- 172.21.15.160:0/1045462588 >> 172.21.15.160:0/1045462588 conn(0x7f78940c7f60 msgr2=0x7f78940c3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.204 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.199+0000 7f789bb42700 1 -- 172.21.15.160:0/1045462588 shutdown_connections 2022-03-21T13:54:35.205 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.200+0000 7f194bf23700 1 Processor -- start 2022-03-21T13:54:35.205 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.200+0000 7f789bb42700 1 -- 172.21.15.160:0/1045462588 wait complete. 2022-03-21T13:54:35.206 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.200+0000 7f194bf23700 1 -- start start 2022-03-21T13:54:35.206 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.201+0000 7f39ebe2d700 1 Processor -- start 2022-03-21T13:54:35.207 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.201+0000 7f789bb42700 1 Processor -- start 2022-03-21T13:54:35.207 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.201+0000 7f194bf23700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c4b90 0x7f19440c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.208 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.201+0000 7f194bf23700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f19440c4f60 0x7f1944152c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.208 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.201+0000 7f194bf23700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19440669f0 con 0x7f19440c36d0 2022-03-21T13:54:35.208 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.201+0000 7f194bf23700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1944067570 con 0x7f19440c4f60 2022-03-21T13:54:35.208 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.201+0000 7f194bf23700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194406c780 con 0x7f19440c4b90 2022-03-21T13:54:35.209 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f789bb42700 1 -- start start 2022-03-21T13:54:35.209 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f1949cbf700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c4b90 0x7f19440c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.210 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f1949cbf700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c4b90 0x7f19440c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:46982/0 (socket says 172.21.15.160:46982) 2022-03-21T13:54:35.210 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f1949cbf700 1 -- 172.21.15.160:0/2668036973 learned_addr learned my addr 172.21.15.160:0/2668036973 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.210 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f1949cbf700 1 -- 172.21.15.160:0/2668036973 >> v2:172.21.15.171:3300/0 conn(0x7f19440c4f60 msgr2=0x7f1944152c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-03-21T13:54:35.210 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f1949cbf700 1 --2- 172.21.15.160:0/2668036973 >> v2:172.21.15.171:3300/0 conn(0x7f19440c4f60 0x7f1944152c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.211 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.201+0000 7f39ebe2d700 1 -- start start 2022-03-21T13:54:35.211 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f1949cbf700 1 -- 172.21.15.160:0/2668036973 >> v1:172.21.15.160:6789/0 conn(0x7f19440c36d0 legacy=0x7f194406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:35.211 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f1949cbf700 1 -- 172.21.15.160:0/2668036973 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1944159af0 con 0x7f19440c4b90 2022-03-21T13:54:35.212 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f39ebe2d700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f39e4159970 0x7f39e4067f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.212 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f39ebe2d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f39e406d840 0x7f39e4068450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.213 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f39ebe2d700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159d40 0x7f39e40c2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.213 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f39ebe2d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e40c21e0 con 0x7f39e406d840 2022-03-21T13:54:35.213 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f39ebe2d700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e405dc80 con 0x7f39e4159970 2022-03-21T13:54:35.213 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f39ebe2d700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40bee30 con 0x7f39e4159d40 2022-03-21T13:54:35.213 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f39e9bc9700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f39e4159970 0x7f39e4067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.214 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.202+0000 7f1949cbf700 1 --2- 172.21.15.160:0/2668036973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c4b90 0x7f19440c6280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1940006fd0 tx=0x7f19400090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbd44537aacb1c2b server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.214 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f39e9bc9700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f39e4159970 0x7f39e4067f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59528/0 (socket says 172.21.15.160:59528) 2022-03-21T13:54:35.215 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f39e9bc9700 1 -- 172.21.15.160:0/2084622507 learned_addr learned my addr 172.21.15.160:0/2084622507 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.215 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f789bb42700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f789405dc80 0x7f789414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.215 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f789bb42700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78940c2250 0x7f789414e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.216 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f789bb42700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940c35f0 0x7f7894150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.216 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f789bb42700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894152420 con 0x7f78940c2250 2022-03-21T13:54:35.216 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f789bb42700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894151570 con 0x7f78940c35f0 2022-03-21T13:54:35.216 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f789bb42700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7894151810 con 0x7f789405dc80 2022-03-21T13:54:35.216 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f789a0df700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940c35f0 0x7f7894150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.217 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f78990dd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78940c2250 0x7f789414e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.217 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f1948cbd700 1 -- 172.21.15.160:0/2668036973 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940011630 con 0x7f19440c4b90 2022-03-21T13:54:35.217 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f1948cbd700 1 -- 172.21.15.160:0/2668036973 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19400117b0 con 0x7f19440c4b90 2022-03-21T13:54:35.218 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f1948cbd700 1 -- 172.21.15.160:0/2668036973 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940011b70 con 0x7f19440c4b90 2022-03-21T13:54:35.218 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f78990dd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78940c2250 0x7f789414e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56596/0 (socket says 172.21.15.160:56596) 2022-03-21T13:54:35.218 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f78990dd700 1 -- 172.21.15.160:0/349397040 learned_addr learned my addr 172.21.15.160:0/349397040 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.219 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f39ea3ca700 1 --2- 172.21.15.160:0/2084622507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159d40 0x7f39e40c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.219 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f39e93c8700 1 --2- 172.21.15.160:0/2084622507 >> v2:172.21.15.160:3300/0 conn(0x7f39e406d840 0x7f39e4068450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.220 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f39e9bc9700 1 -- 172.21.15.160:0/2084622507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159d40 msgr2=0x7f39e40c2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:35.220 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f39e9bc9700 1 --2- 172.21.15.160:0/2084622507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159d40 0x7f39e40c2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.220 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f39e9bc9700 1 -- 172.21.15.160:0/2084622507 >> v2:172.21.15.160:3300/0 conn(0x7f39e406d840 msgr2=0x7f39e4068450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:35.220 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f39e9bc9700 1 --2- 172.21.15.160:0/2084622507 >> v2:172.21.15.160:3300/0 conn(0x7f39e406d840 0x7f39e4068450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.220 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f39e9bc9700 1 -- 172.21.15.160:0/2084622507 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e40c1e70 con 0x7f39e4159970 2022-03-21T13:54:35.221 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f39e9bc9700 1 --2- 172.21.15.160:0/2084622507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39e4159970 0x7f39e4067f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f39e4069b10 tx=0x7f39d8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72e7c278cf83e016 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.221 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f789a0df700 1 -- 172.21.15.160:0/349397040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f789405dc80 msgr2=0x7f789414e230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-03-21T13:54:35.222 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.203+0000 7f789a0df700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f789405dc80 0x7f789414e230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.222 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.204+0000 7f789a0df700 1 -- 172.21.15.160:0/349397040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78940c2250 msgr2=0x7f789414e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.222 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.204+0000 7f789a0df700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78940c2250 0x7f789414e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.222 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.204+0000 7f789a0df700 1 -- 172.21.15.160:0/349397040 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c009ae0 con 0x7f78940c35f0 2022-03-21T13:54:35.223 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.204+0000 7f789a0df700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940c35f0 0x7f7894150230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f788c015000 tx=0x7f788c018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.223 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.204+0000 7f194bf23700 1 -- 172.21.15.160:0/2668036973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c4b90 msgr2=0x7f19440c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.223 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.204+0000 7f194bf23700 1 --2- 172.21.15.160:0/2668036973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c4b90 0x7f19440c6280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1940006fd0 tx=0x7f19400090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.224 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.204+0000 7f7881ffb700 1 -- 172.21.15.160:0/349397040 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c004040 con 0x7f78940c35f0 2022-03-21T13:54:35.224 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.204+0000 7f7881ffb700 1 -- 172.21.15.160:0/349397040 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c004200 con 0x7f78940c35f0 2022-03-21T13:54:35.224 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.204+0000 7f7881ffb700 1 -- 172.21.15.160:0/349397040 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c0045c0 con 0x7f78940c35f0 2022-03-21T13:54:35.225 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.205+0000 7f789bb42700 1 -- 172.21.15.160:0/349397040 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7894151af0 con 0x7f78940c35f0 2022-03-21T13:54:35.225 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.205+0000 7f789bb42700 1 -- 172.21.15.160:0/349397040 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78941520b0 con 0x7f78940c35f0 2022-03-21T13:54:35.226 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.205+0000 7f39e8bc7700 1 -- 172.21.15.160:0/2084622507 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d800e070 con 0x7f39e4159970 2022-03-21T13:54:35.226 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.205+0000 7f39e8bc7700 1 -- 172.21.15.160:0/2084622507 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d800b970 con 0x7f39e4159970 2022-03-21T13:54:35.227 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.205+0000 7f39e8bc7700 1 -- 172.21.15.160:0/2084622507 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80092e0 con 0x7f39e4159970 2022-03-21T13:54:35.227 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.206+0000 7f39ebe2d700 1 -- 172.21.15.160:0/2084622507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39e4159970 msgr2=0x7f39e4067f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.227 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.206+0000 7f39ebe2d700 1 --2- 172.21.15.160:0/2084622507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39e4159970 0x7f39e4067f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f39e4069b10 tx=0x7f39d8009840 comp rx=0 tx=0).stop 2022-03-21T13:54:35.227 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.206+0000 7f39ebe2d700 1 -- 172.21.15.160:0/2084622507 shutdown_connections 2022-03-21T13:54:35.228 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.206+0000 7f39ebe2d700 1 --2- 172.21.15.160:0/2084622507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159d40 0x7f39e40c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.228 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.206+0000 7f39ebe2d700 1 --2- 172.21.15.160:0/2084622507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39e4159970 0x7f39e4067f10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.228 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.206+0000 7f39ebe2d700 1 --2- 172.21.15.160:0/2084622507 >> v2:172.21.15.160:3300/0 conn(0x7f39e406d840 0x7f39e4068450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.228 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.206+0000 7f39ebe2d700 1 -- 172.21.15.160:0/2084622507 >> 172.21.15.160:0/2084622507 conn(0x7f39e40c3fc0 msgr2=0x7f39e40c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.229 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.207+0000 7f7881ffb700 1 -- 172.21.15.160:0/349397040 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f788c007610 con 0x7f78940c35f0 2022-03-21T13:54:35.229 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.207+0000 7f789bb42700 1 -- 172.21.15.160:0/349397040 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789406fc00 con 0x7f78940c35f0 2022-03-21T13:54:35.229 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.207+0000 7f39ebe2d700 1 -- 172.21.15.160:0/2084622507 shutdown_connections 2022-03-21T13:54:35.230 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.207+0000 7f7881ffb700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7874063db0 0x7f7874066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.230 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.207+0000 7f7881ffb700 1 -- 172.21.15.160:0/349397040 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f788c0824a0 con 0x7f78940c35f0 2022-03-21T13:54:35.230 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.207+0000 7f78998de700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7874063db0 0x7f7874066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.231 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.208+0000 7f39ebe2d700 1 -- 172.21.15.160:0/2084622507 wait complete. 2022-03-21T13:54:35.231 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.208+0000 7f78998de700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7874063db0 0x7f7874066260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7890006fd0 tx=0x7f7890006bb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.232 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.208+0000 7fec3e6a8700 1 Processor -- start 2022-03-21T13:54:35.232 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.208+0000 7fec3e6a8700 1 -- start start 2022-03-21T13:54:35.232 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f4021bc0700 1 Processor -- start 2022-03-21T13:54:35.233 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.208+0000 7f3c69e71700 1 Processor -- start 2022-03-21T13:54:35.233 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.208+0000 7f3c69e71700 1 -- start start 2022-03-21T13:54:35.234 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f3c69e71700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c64159db0 0x7f3c640c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.234 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f3c69e71700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3c640c2ea0 0x7f3c64067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.234 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f3c69e71700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c640c1d40 con 0x7f3c641599e0 2022-03-21T13:54:35.234 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f3c69e71700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6406cb90 con 0x7f3c640c2ea0 2022-03-21T13:54:35.235 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f3c69e71700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6406ce70 con 0x7f3c64159db0 2022-03-21T13:54:35.235 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f39ebe2d700 1 Processor -- start 2022-03-21T13:54:35.236 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f194bf23700 1 -- 172.21.15.160:0/2668036973 shutdown_connections 2022-03-21T13:54:35.236 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f194bf23700 1 --2- 172.21.15.160:0/2668036973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c4b90 0x7f19440c6280 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.236 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f194bf23700 1 --2- 172.21.15.160:0/2668036973 >> v2:172.21.15.171:3300/0 conn(0x7f19440c4f60 0x7f1944152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.236 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f194bf23700 1 -- 172.21.15.160:0/2668036973 >> 172.21.15.160:0/2668036973 conn(0x7f19440c98f0 msgr2=0x7f19440c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.237 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f3c637fe700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f3c641599e0 0x7f3c640c2790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:52844/0 (socket says 172.21.15.160:52844) 2022-03-21T13:54:35.237 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f3c637fe700 1 -- 172.21.15.160:0/3443831911 learned_addr learned my addr 172.21.15.160:0/3443831911 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:35.237 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f194bf23700 1 -- 172.21.15.160:0/2668036973 shutdown_connections 2022-03-21T13:54:35.238 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f51f405d700 1 Processor -- start 2022-03-21T13:54:35.239 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7fec3e6a8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fec3806a100 0x7fec380bebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.239 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7fec3e6a8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3806d0d0 con 0x7fec380be460 2022-03-21T13:54:35.239 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7fec3e6a8700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3806b630 con 0x7fec380c7890 2022-03-21T13:54:35.239 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7fec3e6a8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec38086d90 con 0x7fec3806a100 2022-03-21T13:54:35.240 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7fec377fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fec3806a100 0x7fec380bebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.240 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7fec3cc45700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fec380c7890 0x7fec38086680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:52852/0 (socket says 172.21.15.160:52852) 2022-03-21T13:54:35.240 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7fec3cc45700 1 -- 172.21.15.160:0/2456641514 learned_addr learned my addr 172.21.15.160:0/2456641514 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:35.240 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7fec377fe700 1 -- 172.21.15.160:0/2456641514 >> v1:172.21.15.171:6789/0 conn(0x7fec380c7890 legacy=0x7fec38086680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:35.241 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7fec377fe700 1 -- 172.21.15.160:0/2456641514 >> v1:172.21.15.160:6789/0 conn(0x7fec380be460 legacy=0x7fec381659a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.241 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7fec377fe700 1 -- 172.21.15.160:0/2456641514 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3806b8a0 con 0x7fec3806a100 2022-03-21T13:54:35.241 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f4021bc0700 1 -- start start 2022-03-21T13:54:35.242 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f4021bc0700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f401c06d450 0x7f401c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.242 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f4021bc0700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f401c0c7890 0x7f401c06c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.242 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f4021bc0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c06b810 con 0x7f401c06a010 2022-03-21T13:54:35.242 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f4021bc0700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401c1597a0 con 0x7f401c0c7890 2022-03-21T13:54:35.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f4021bc0700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c06b570 con 0x7f401c06d450 2022-03-21T13:54:35.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f401b7fe700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f401c06d450 0x7f401c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f401b7fe700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f401c06d450 0x7f401c06c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47012/0 (socket says 172.21.15.160:47012) 2022-03-21T13:54:35.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f401b7fe700 1 -- 172.21.15.160:0/2050090430 learned_addr learned my addr 172.21.15.160:0/2050090430 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f401affd700 1 --2- 172.21.15.160:0/2050090430 >> v2:172.21.15.171:3300/0 conn(0x7f401c0c7890 0x7f401c06c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.244 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f39ebe2d700 1 -- start start 2022-03-21T13:54:35.244 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39ebe2d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39e406d840 0x7f39e414b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.244 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39ebe2d700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159970 0x7f39e41324e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.244 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39ebe2d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e4159d40 0x7f39e4132a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.245 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39ebe2d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e41593d0 con 0x7f39e4159d40 2022-03-21T13:54:35.245 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39ebe2d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e4132050 con 0x7f39e406d840 2022-03-21T13:54:35.245 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39ebe2d700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e413d100 con 0x7f39e4159970 2022-03-21T13:54:35.246 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7fec377fe700 1 --2- 172.21.15.160:0/2456641514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec3806a100 0x7fec380bebd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009760 tx=0x7fec2c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d6460e7dcc049f server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.246 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39e93c8700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159970 0x7f39e41324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.246 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39e93c8700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159970 0x7f39e41324e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47018/0 (socket says 172.21.15.160:47018) 2022-03-21T13:54:35.247 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39e93c8700 1 -- 172.21.15.160:0/3843860319 learned_addr learned my addr 172.21.15.160:0/3843860319 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.247 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f401affd700 1 -- 172.21.15.160:0/2050090430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f401c06d450 msgr2=0x7f401c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:35.248 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f401affd700 1 --2- 172.21.15.160:0/2050090430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f401c06d450 0x7f401c06c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.248 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f401affd700 1 -- 172.21.15.160:0/2050090430 >> v1:172.21.15.160:6789/0 conn(0x7f401c06a010 legacy=0x7f401c15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.248 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f401affd700 1 -- 172.21.15.160:0/2050090430 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c159980 con 0x7f401c0c7890 2022-03-21T13:54:35.248 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f401affd700 1 --2- 172.21.15.160:0/2050090430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c0c7890 0x7f401c06c5b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4010009760 tx=0x7f4010009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73838575b151734 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.249 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.209+0000 7f3c62ffd700 1 --2- 172.21.15.160:0/3443831911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c64159db0 0x7f3c640c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.249 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f3c62ffd700 1 -- 172.21.15.160:0/3443831911 >> v2:172.21.15.171:3300/0 conn(0x7f3c640c2ea0 msgr2=0x7f3c64067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:35.249 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f3c62ffd700 1 --2- 172.21.15.160:0/3443831911 >> v2:172.21.15.171:3300/0 conn(0x7f3c640c2ea0 0x7f3c64067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.249 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f3c62ffd700 1 -- 172.21.15.160:0/3443831911 >> v1:172.21.15.171:6789/0 conn(0x7f3c641599e0 legacy=0x7f3c640c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.250 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f3c62ffd700 1 -- 172.21.15.160:0/3443831911 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6406d150 con 0x7f3c64159db0 2022-03-21T13:54:35.250 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f3c62ffd700 1 --2- 172.21.15.160:0/3443831911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c64159db0 0x7f3c640c46f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009e60 tx=0x7f3c5c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea8a4bcc90c75154 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.250 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f3c627fc700 1 -- 172.21.15.160:0/3443831911 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c00e070 con 0x7f3c64159db0 2022-03-21T13:54:35.250 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f3c627fc700 1 -- 172.21.15.160:0/3443831911 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c00bc30 con 0x7f3c64159db0 2022-03-21T13:54:35.251 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f3c627fc700 1 -- 172.21.15.160:0/3443831911 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c012430 con 0x7f3c64159db0 2022-03-21T13:54:35.251 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39e93c8700 1 -- 172.21.15.160:0/3843860319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39e406d840 msgr2=0x7f39e414b020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-03-21T13:54:35.251 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39e93c8700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39e406d840 0x7f39e414b020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.252 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39e93c8700 1 -- 172.21.15.160:0/3843860319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e4159d40 msgr2=0x7f39e4132a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-03-21T13:54:35.252 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39e93c8700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e4159d40 0x7f39e4132a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.252 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f39e93c8700 1 -- 172.21.15.160:0/3843860319 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d8009ae0 con 0x7f39e4159970 2022-03-21T13:54:35.252 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7fec36ffd700 1 -- 172.21.15.160:0/2456641514 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c004030 con 0x7fec3806a100 2022-03-21T13:54:35.253 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7fec36ffd700 1 -- 172.21.15.160:0/2456641514 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c004190 con 0x7fec3806a100 2022-03-21T13:54:35.253 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7fec36ffd700 1 -- 172.21.15.160:0/2456641514 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c011630 con 0x7fec3806a100 2022-03-21T13:54:35.253 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f194bf23700 1 -- 172.21.15.160:0/2668036973 wait complete. 2022-03-21T13:54:35.254 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f194bf23700 1 Processor -- start 2022-03-21T13:54:35.254 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f194bf23700 1 -- start start 2022-03-21T13:54:35.254 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f39e93c8700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159970 0x7f39e41324e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f39d000e900 tx=0x7f39d0009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.255 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.210+0000 7f51f405d700 1 -- start start 2022-03-21T13:54:35.256 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f405d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f51ec0c45d0 0x7f51ec0c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.256 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f405d700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f51ec06ac50 0x7f51ec0c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.256 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f405d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec06b6d0 con 0x7f51ec0c49a0 2022-03-21T13:54:35.256 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f405d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0c7300 con 0x7f51ec0c45d0 2022-03-21T13:54:35.256 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f405d700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec06a6d0 con 0x7f51ec06ac50 2022-03-21T13:54:35.257 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f1df9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f51ec0c45d0 0x7f51ec0c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.257 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f1df9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f51ec0c45d0 0x7f51ec0c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56624/0 (socket says 172.21.15.160:56624) 2022-03-21T13:54:35.257 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f1df9700 1 -- 172.21.15.160:0/3164227522 learned_addr learned my addr 172.21.15.160:0/3164227522 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.257 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f15f8700 1 --2- 172.21.15.160:0/3164227522 >> v2:172.21.15.171:3300/0 conn(0x7f51ec06ac50 0x7f51ec0c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.258 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f0df7700 1 -- 172.21.15.160:0/3164227522 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612263072 0 0) 0x7f51ec06b6d0 con 0x7f51ec0c49a0 2022-03-21T13:54:35.258 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f0df7700 1 -- 172.21.15.160:0/3164227522 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d40033f0 con 0x7f51ec0c49a0 2022-03-21T13:54:35.258 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.211+0000 7f51f15f8700 1 -- 172.21.15.160:0/3164227522 >> v2:172.21.15.160:3300/0 conn(0x7f51ec0c45d0 msgr2=0x7f51ec0c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:35.258 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f51f15f8700 1 --2- 172.21.15.160:0/3164227522 >> v2:172.21.15.160:3300/0 conn(0x7f51ec0c45d0 0x7f51ec0c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.258 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f51f15f8700 1 -- 172.21.15.160:0/3164227522 >> v1:172.21.15.160:6789/0 conn(0x7f51ec0c49a0 legacy=0x7f51ec0c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.259 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f51f15f8700 1 -- 172.21.15.160:0/3164227522 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec06b900 con 0x7f51ec06ac50 2022-03-21T13:54:35.259 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f51f1df9700 1 --2- 172.21.15.160:0/3164227522 >> v2:172.21.15.160:3300/0 conn(0x7f51ec0c45d0 0x7f51ec0c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:35.259 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f51f15f8700 1 --2- 172.21.15.160:0/3164227522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51ec06ac50 0x7f51ec0c5df0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51ec069fc0 tx=0x7f51dc009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acee86ad8be0753a server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.260 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f39e1ffb700 1 -- 172.21.15.160:0/3843860319 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d000eea0 con 0x7f39e4159970 2022-03-21T13:54:35.260 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f39e1ffb700 1 -- 172.21.15.160:0/3843860319 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d000c8e0 con 0x7f39e4159970 2022-03-21T13:54:35.260 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f39e1ffb700 1 -- 172.21.15.160:0/3843860319 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d000cc80 con 0x7f39e4159970 2022-03-21T13:54:35.260 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f39ebe2d700 1 -- 172.21.15.160:0/3843860319 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e4134c80 con 0x7f39e4159970 2022-03-21T13:54:35.261 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2456641514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec3806a100 msgr2=0x7fec380bebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.261 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7fec3e6a8700 1 --2- 172.21.15.160:0/2456641514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec3806a100 0x7fec380bebd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009760 tx=0x7fec2c009060 comp rx=0 tx=0).stop 2022-03-21T13:54:35.262 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f39ebe2d700 1 -- 172.21.15.160:0/3843860319 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e41351e0 con 0x7f39e4159970 2022-03-21T13:54:35.262 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f3c69e71700 1 -- 172.21.15.160:0/3443831911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c64159db0 msgr2=0x7f3c640c46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.262 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f3c69e71700 1 --2- 172.21.15.160:0/3443831911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c64159db0 0x7f3c640c46f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009e60 tx=0x7f3c5c009780 comp rx=0 tx=0).stop 2022-03-21T13:54:35.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f194bf23700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c36d0 0x7f194415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f194bf23700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19440c4b90 0x7f19441581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f194bf23700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19440c4f60 0x7f1944158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.264 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f194bf23700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19441547e0 con 0x7f19440c4b90 2022-03-21T13:54:35.264 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f194bf23700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19441538f0 con 0x7f19440c4f60 2022-03-21T13:54:35.264 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f194bf23700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1944153bd0 con 0x7f19440c36d0 2022-03-21T13:54:35.265 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f401a7fc700 1 -- 172.21.15.160:0/2050090430 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010011630 con 0x7f401c0c7890 2022-03-21T13:54:35.265 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f401a7fc700 1 -- 172.21.15.160:0/2050090430 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4010011790 con 0x7f401c0c7890 2022-03-21T13:54:35.265 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f401a7fc700 1 -- 172.21.15.160:0/2050090430 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010011b10 con 0x7f401c0c7890 2022-03-21T13:54:35.266 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f19494be700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19440c4b90 0x7f19441581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.266 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f19494be700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19440c4b90 0x7f19441581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56630/0 (socket says 172.21.15.160:56630) 2022-03-21T13:54:35.266 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f19494be700 1 -- 172.21.15.160:0/2888602161 learned_addr learned my addr 172.21.15.160:0/2888602161 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.267 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f3c69e71700 1 -- 172.21.15.160:0/3443831911 shutdown_connections 2022-03-21T13:54:35.267 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f3c69e71700 1 --2- 172.21.15.160:0/3443831911 >> v2:172.21.15.171:3300/0 conn(0x7f3c640c2ea0 0x7f3c64067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.267 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f3c69e71700 1 --2- 172.21.15.160:0/3443831911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c64159db0 0x7f3c640c46f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.268 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f3c69e71700 1 -- 172.21.15.160:0/3443831911 >> 172.21.15.160:0/3443831911 conn(0x7f3c640c7f60 msgr2=0x7f3c640c3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.268 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f1949cbf700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c36d0 0x7f194415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f194a4c0700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19440c4f60 0x7f1944158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f19494be700 1 -- 172.21.15.160:0/2888602161 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c36d0 msgr2=0x7f194415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f19494be700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c36d0 0x7f194415cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f19494be700 1 -- 172.21.15.160:0/2888602161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19440c4f60 msgr2=0x7f1944158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f19494be700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19440c4f60 0x7f1944158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f19494be700 1 -- 172.21.15.160:0/2888602161 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1940009370 con 0x7f19440c4b90 2022-03-21T13:54:35.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f3c69e71700 1 -- 172.21.15.160:0/3443831911 shutdown_connections 2022-03-21T13:54:35.271 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f19494be700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19440c4b90 0x7f19441581e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f193400c490 tx=0x7f1934007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.271 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f51f0df7700 1 -- 172.21.15.160:0/3164227522 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0105b0 con 0x7f51ec06ac50 2022-03-21T13:54:35.272 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.212+0000 7f7881ffb700 1 -- 172.21.15.160:0/349397040 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f788c051100 con 0x7f78940c35f0 2022-03-21T13:54:35.272 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f51f0df7700 1 -- 172.21.15.160:0/3164227522 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc010710 con 0x7f51ec06ac50 2022-03-21T13:54:35.272 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f51f0df7700 1 -- 172.21.15.160:0/3164227522 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc010a90 con 0x7f51ec06ac50 2022-03-21T13:54:35.273 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f4021bc0700 1 -- 172.21.15.160:0/2050090430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c0c7890 msgr2=0x7f401c06c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.273 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.213+0000 7f4021bc0700 1 --2- 172.21.15.160:0/2050090430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c0c7890 0x7f401c06c5b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4010009760 tx=0x7f4010009060 comp rx=0 tx=0).stop 2022-03-21T13:54:35.273 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f3c69e71700 1 -- 172.21.15.160:0/3443831911 wait complete. 2022-03-21T13:54:35.274 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f4021bc0700 1 -- 172.21.15.160:0/2050090430 shutdown_connections 2022-03-21T13:54:35.274 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f4021bc0700 1 --2- 172.21.15.160:0/2050090430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f401c06d450 0x7f401c06c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.274 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f4021bc0700 1 --2- 172.21.15.160:0/2050090430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c0c7890 0x7f401c06c5b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.275 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f4021bc0700 1 -- 172.21.15.160:0/2050090430 >> 172.21.15.160:0/2050090430 conn(0x7f401c068620 msgr2=0x7f401c0c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f1931ffb700 1 -- 172.21.15.160:0/2888602161 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340052e0 con 0x7f19440c4b90 2022-03-21T13:54:35.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f1931ffb700 1 -- 172.21.15.160:0/2888602161 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19340034c0 con 0x7f19440c4b90 2022-03-21T13:54:35.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f1931ffb700 1 -- 172.21.15.160:0/2888602161 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934003880 con 0x7f19440c4b90 2022-03-21T13:54:35.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f51f405d700 1 -- 172.21.15.160:0/3164227522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51ec06ac50 msgr2=0x7f51ec0c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f51f405d700 1 --2- 172.21.15.160:0/3164227522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51ec06ac50 0x7f51ec0c5df0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51ec069fc0 tx=0x7f51dc009060 comp rx=0 tx=0).stop 2022-03-21T13:54:35.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f51f405d700 1 -- 172.21.15.160:0/3164227522 shutdown_connections 2022-03-21T13:54:35.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f51f405d700 1 --2- 172.21.15.160:0/3164227522 >> v2:172.21.15.160:3300/0 conn(0x7f51ec0c45d0 0x7f51ec0c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f51f405d700 1 --2- 172.21.15.160:0/3164227522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51ec06ac50 0x7f51ec0c5df0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f51f405d700 1 -- 172.21.15.160:0/3164227522 >> 172.21.15.160:0/3164227522 conn(0x7f51ec068650 msgr2=0x7f51ec0cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f51f405d700 1 -- 172.21.15.160:0/3164227522 shutdown_connections 2022-03-21T13:54:35.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f51f405d700 1 -- 172.21.15.160:0/3164227522 wait complete. 2022-03-21T13:54:35.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.215+0000 7f3c69e71700 1 Processor -- start 2022-03-21T13:54:35.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.215+0000 7f194bf23700 1 -- 172.21.15.160:0/2888602161 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1944153eb0 con 0x7f19440c4b90 2022-03-21T13:54:35.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.215+0000 7f194bf23700 1 -- 172.21.15.160:0/2888602161 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1944154470 con 0x7f19440c4b90 2022-03-21T13:54:35.280 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.215+0000 7f3c69e71700 1 -- start start 2022-03-21T13:54:35.281 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f3c69e71700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c640c2ea0 0x7f3c6416ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.281 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f3c69e71700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c641599e0 0x7f3c640c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.281 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f3c69e71700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c64159db0 0x7f3c641696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.281 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f3c69e71700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c640bceb0 con 0x7f3c641599e0 2022-03-21T13:54:35.281 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f3c69e71700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c640b4f50 con 0x7f3c64159db0 2022-03-21T13:54:35.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f3c69e71700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6416c670 con 0x7f3c640c2ea0 2022-03-21T13:54:35.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c64159db0 0x7f3c641696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c64159db0 0x7f3c641696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59578/0 (socket says 172.21.15.160:59578) 2022-03-21T13:54:35.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f3c63fff700 1 -- 172.21.15.160:0/253870121 learned_addr learned my addr 172.21.15.160:0/253870121 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.215+0000 7f51f405d700 1 Processor -- start 2022-03-21T13:54:35.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.215+0000 7f51f405d700 1 -- start start 2022-03-21T13:54:35.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f51f405d700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51ec0c45d0 0x7f51ec1613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c62ffd700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c641599e0 0x7f3c640c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f51f405d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec0c49a0 0x7f51ec146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f51f405d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51ec1444d0 0x7f51ec0c1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f51f405d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec147c20 con 0x7f51ec0c49a0 2022-03-21T13:54:35.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f51f405d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0bf430 con 0x7f51ec1444d0 2022-03-21T13:54:35.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f51f405d700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1449d0 con 0x7f51ec0c45d0 2022-03-21T13:54:35.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f51f1df9700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51ec0c45d0 0x7f51ec1613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f51f15f8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec0c49a0 0x7f51ec146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f51f1df9700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51ec0c45d0 0x7f51ec1613b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47042/0 (socket says 172.21.15.160:47042) 2022-03-21T13:54:35.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f51f15f8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec0c49a0 0x7f51ec146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56644/0 (socket says 172.21.15.160:56644) 2022-03-21T13:54:35.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f51f1df9700 1 -- 172.21.15.160:0/1461850279 learned_addr learned my addr 172.21.15.160:0/1461850279 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f51f25fa700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51ec1444d0 0x7f51ec0c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c63fff700 1 -- 172.21.15.160:0/253870121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c640c2ea0 msgr2=0x7f3c6416ce30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-03-21T13:54:35.288 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c63fff700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c640c2ea0 0x7f3c6416ce30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.288 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c63fff700 1 -- 172.21.15.160:0/253870121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c641599e0 msgr2=0x7f3c640c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.288 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c63fff700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c641599e0 0x7f3c640c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.288 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c63fff700 1 -- 172.21.15.160:0/253870121 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c009a20 con 0x7f3c64159db0 2022-03-21T13:54:35.288 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c63fff700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c64159db0 0x7f3c641696d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800b410 tx=0x7f3c58006f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.289 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c4b7fe700 1 -- 172.21.15.160:0/253870121 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800be70 con 0x7f3c64159db0 2022-03-21T13:54:35.289 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f51f25fa700 1 -- 172.21.15.160:0/1461850279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51ec0c45d0 msgr2=0x7f51ec1613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.289 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f51f25fa700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51ec0c45d0 0x7f51ec1613b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.290 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f51f25fa700 1 -- 172.21.15.160:0/1461850279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec0c49a0 msgr2=0x7f51ec146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.290 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f51f25fa700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec0c49a0 0x7f51ec146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.290 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c4b7fe700 1 -- 172.21.15.160:0/253870121 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c58011630 con 0x7f3c64159db0 2022-03-21T13:54:35.291 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f51f25fa700 1 -- 172.21.15.160:0/1461850279 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e4009ae0 con 0x7f51ec1444d0 2022-03-21T13:54:35.291 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c4b7fe700 1 -- 172.21.15.160:0/253870121 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c580119d0 con 0x7f3c64159db0 2022-03-21T13:54:35.292 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c69e71700 1 -- 172.21.15.160:0/253870121 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c640bf680 con 0x7f3c64159db0 2022-03-21T13:54:35.292 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f3c69e71700 1 -- 172.21.15.160:0/253870121 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c640b7a40 con 0x7f3c64159db0 2022-03-21T13:54:35.292 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.218+0000 7f4021bc0700 1 -- 172.21.15.160:0/2050090430 shutdown_connections 2022-03-21T13:54:35.293 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.218+0000 7f3c69e71700 1 -- 172.21.15.160:0/253870121 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c640c0810 con 0x7f3c64159db0 2022-03-21T13:54:35.293 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f194bf23700 1 -- 172.21.15.160:0/2888602161 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1944154950 con 0x7f19440c4b90 2022-03-21T13:54:35.294 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.218+0000 7f1931ffb700 1 -- 172.21.15.160:0/2888602161 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f1934010070 con 0x7f19440c4b90 2022-03-21T13:54:35.294 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.218+0000 7f1931ffb700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1924063d60 0x7f1924066210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.294 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.218+0000 7f1949cbf700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1924063d60 0x7f1924066210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.294 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.218+0000 7f1931ffb700 1 -- 172.21.15.160:0/2888602161 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f193407f830 con 0x7f19440c4b90 2022-03-21T13:54:35.295 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.218+0000 7f4021bc0700 1 -- 172.21.15.160:0/2050090430 wait complete. 2022-03-21T13:54:35.295 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.219+0000 7f1949cbf700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1924063d60 0x7f1924066210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1940006fd0 tx=0x7f1940017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.296 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.219+0000 7f3c4b7fe700 1 -- 172.21.15.160:0/253870121 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f3c58021070 con 0x7f3c64159db0 2022-03-21T13:54:35.296 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.220+0000 7f3c4b7fe700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3c44063ce0 0x7f3c44066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.297 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.220+0000 7f3c637fe700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3c44063ce0 0x7f3c44066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.297 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.220+0000 7f3c4b7fe700 1 -- 172.21.15.160:0/253870121 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3c58080630 con 0x7f3c64159db0 2022-03-21T13:54:35.297 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.220+0000 7f4021bc0700 1 Processor -- start 2022-03-21T13:54:35.298 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.220+0000 7f3c637fe700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3c44063ce0 0x7f3c44066190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c54005750 tx=0x7f3c54007940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.298 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.214+0000 7f39ebe2d700 1 -- 172.21.15.160:0/3843860319 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e40be7a0 con 0x7f39e4159970 2022-03-21T13:54:35.298 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.215+0000 7f39e1ffb700 1 -- 172.21.15.160:0/3843860319 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f39d0023070 con 0x7f39e4159970 2022-03-21T13:54:35.299 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f39e1ffb700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f39cc063ce0 0x7f39cc066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.299 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f39e1ffb700 1 -- 172.21.15.160:0/3843860319 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f39d0081140 con 0x7f39e4159970 2022-03-21T13:54:35.299 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.216+0000 7f39e9bc9700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f39cc063ce0 0x7f39cc066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.300 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.217+0000 7f39e9bc9700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f39cc063ce0 0x7f39cc066190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009ab0 tx=0x7f39d8018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.300 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.220+0000 7f39e1ffb700 1 -- 172.21.15.160:0/3843860319 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f39d004fd40 con 0x7f39e4159970 2022-03-21T13:54:35.301 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.222+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2456641514 shutdown_connections 2022-03-21T13:54:35.301 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.222+0000 7fec3e6a8700 1 --2- 172.21.15.160:0/2456641514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec3806a100 0x7fec380bebd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.301 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.222+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2456641514 >> 172.21.15.160:0/2456641514 conn(0x7fec38068620 msgr2=0x7fec380c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.301 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.223+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2456641514 shutdown_connections 2022-03-21T13:54:35.302 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.223+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2456641514 wait complete. 2022-03-21T13:54:35.302 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.223+0000 7f51f25fa700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51ec1444d0 0x7f51ec0c1140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c410 tx=0x7f51e8007b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.303 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.224+0000 7f51d9ffb700 1 -- 172.21.15.160:0/1461850279 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80050d0 con 0x7f51ec1444d0 2022-03-21T13:54:35.303 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.224+0000 7f51d9ffb700 1 -- 172.21.15.160:0/1461850279 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8005270 con 0x7f51ec1444d0 2022-03-21T13:54:35.303 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.224+0000 7f51d9ffb700 1 -- 172.21.15.160:0/1461850279 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8003710 con 0x7f51ec1444d0 2022-03-21T13:54:35.303 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.224+0000 7fec3e6a8700 1 Processor -- start 2022-03-21T13:54:35.304 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.224+0000 7f51f405d700 1 -- 172.21.15.160:0/1461850279 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc0092a0 con 0x7f51ec1444d0 2022-03-21T13:54:35.304 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.224+0000 7f3c4b7fe700 1 -- 172.21.15.160:0/253870121 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f3c5804f210 con 0x7f3c64159db0 2022-03-21T13:54:35.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.224+0000 7fec3e6a8700 1 -- start start 2022-03-21T13:54:35.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.225+0000 7fec3e6a8700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3806a100 0x7fec38165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.225+0000 7fec3e6a8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec380be460 0x7fec380af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.225+0000 7fec3e6a8700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec380c7890 0x7fec380afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.225+0000 7fec3e6a8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380af310 con 0x7fec380be460 2022-03-21T13:54:35.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.225+0000 7fec3e6a8700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec38177240 con 0x7fec3806a100 2022-03-21T13:54:35.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.225+0000 7fec3e6a8700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec38176cd0 con 0x7fec380c7890 2022-03-21T13:54:35.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.225+0000 7fec37fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3806a100 0x7fec38165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.225+0000 7fec377fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec380be460 0x7fec380af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.225+0000 7fec37fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3806a100 0x7fec38165240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59592/0 (socket says 172.21.15.160:59592) 2022-03-21T13:54:35.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.225+0000 7fec37fff700 1 -- 172.21.15.160:0/2560774590 learned_addr learned my addr 172.21.15.160:0/2560774590 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.226+0000 7fec377fe700 1 -- 172.21.15.160:0/2560774590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec380c7890 msgr2=0x7fec380afca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-03-21T13:54:35.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.226+0000 7fec377fe700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec380c7890 0x7fec380afca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.226+0000 7fec377fe700 1 -- 172.21.15.160:0/2560774590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3806a100 msgr2=0x7fec38165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.226+0000 7fec377fe700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3806a100 0x7fec38165240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.226+0000 7fec377fe700 1 -- 172.21.15.160:0/2560774590 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c0092a0 con 0x7fec380be460 2022-03-21T13:54:35.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.226+0000 7fec37fff700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3806a100 0x7fec38165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:35.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.226+0000 7fec377fe700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec380be460 0x7fec380af760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fec2c015000 tx=0x7fec2c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.224+0000 7f51f405d700 1 -- 172.21.15.160:0/1461850279 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec1475d0 con 0x7f51ec1444d0 2022-03-21T13:54:35.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.225+0000 7f51d9ffb700 1 -- 172.21.15.160:0/1461850279 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f51e8019030 con 0x7f51ec1444d0 2022-03-21T13:54:35.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.226+0000 7f51d9ffb700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f51cc063d10 0x7f51cc0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.226+0000 7f51d9ffb700 1 -- 172.21.15.160:0/1461850279 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f51e807f7b0 con 0x7f51ec1444d0 2022-03-21T13:54:35.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.226+0000 7f51f1df9700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f51cc063d10 0x7f51cc0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.226+0000 7f51f1df9700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f51cc063d10 0x7f51cc0661c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f51e40093f0 tx=0x7f51e400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.227+0000 7f51f405d700 1 -- 172.21.15.160:0/1461850279 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec147dd0 con 0x7f51ec1444d0 2022-03-21T13:54:35.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.227+0000 7fec1ffff700 1 -- 172.21.15.160:0/2560774590 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0037f0 con 0x7fec380be460 2022-03-21T13:54:35.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.227+0000 7fec1ffff700 1 -- 172.21.15.160:0/2560774590 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c003950 con 0x7fec380be460 2022-03-21T13:54:35.313 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.227+0000 7fec1ffff700 1 -- 172.21.15.160:0/2560774590 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c003cf0 con 0x7fec380be460 2022-03-21T13:54:35.313 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.227+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2560774590 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec380b0d50 con 0x7fec380be460 2022-03-21T13:54:35.313 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.228+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2560774590 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec380b0a40 con 0x7fec380be460 2022-03-21T13:54:35.314 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.227+0000 7f4021bc0700 1 -- start start 2022-03-21T13:54:35.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f4021bc0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f401c06a010 0x7f401c145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f4021bc0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c06d450 0x7f401c0c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f4021bc0700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f401c0c7890 0x7f401c149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f4021bc0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c0c5ef0 con 0x7f401c06a010 2022-03-21T13:54:35.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f4021bc0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c149d20 con 0x7f401c06d450 2022-03-21T13:54:35.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f4021bc0700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c0bcb60 con 0x7f401c0c7890 2022-03-21T13:54:35.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f401affd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c06d450 0x7f401c0c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f401affd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c06d450 0x7f401c0c6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59602/0 (socket says 172.21.15.160:59602) 2022-03-21T13:54:35.316 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f401affd700 1 -- 172.21.15.160:0/3483837482 learned_addr learned my addr 172.21.15.160:0/3483837482 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f401affd700 1 -- 172.21.15.160:0/3483837482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f401c0c7890 msgr2=0x7f401c149000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-03-21T13:54:35.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f401affd700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f401c0c7890 0x7f401c149000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f401affd700 1 -- 172.21.15.160:0/3483837482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f401c06a010 msgr2=0x7f401c145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f401affd700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f401c06a010 0x7f401c145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.317 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.229+0000 7f401affd700 1 -- 172.21.15.160:0/3483837482 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40100092a0 con 0x7f401c06d450 2022-03-21T13:54:35.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.230+0000 7f401affd700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c06d450 0x7f401c0c6340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4010011c30 tx=0x7f4010017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.232+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2560774590 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec380af0e0 con 0x7fec380be460 2022-03-21T13:54:35.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.232+0000 7f51d9ffb700 1 -- 172.21.15.160:0/1461850279 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f51e8048ae0 con 0x7f51ec1444d0 2022-03-21T13:54:35.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.234+0000 7f1931ffb700 1 -- 172.21.15.160:0/2888602161 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f193404e320 con 0x7f19440c4b90 2022-03-21T13:54:35.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.236+0000 7fec1ffff700 1 -- 172.21.15.160:0/2560774590 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fec2c017020 con 0x7fec380be460 2022-03-21T13:54:35.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.236+0000 7fec1ffff700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec18063ce0 0x7fec18066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.236+0000 7fec1ffff700 1 -- 172.21.15.160:0/2560774590 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fec2c082400 con 0x7fec380be460 2022-03-21T13:54:35.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.236+0000 7fec37fff700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec18063ce0 0x7fec18066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.237+0000 7fec37fff700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec18063ce0 0x7fec18066190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec28001c70 tx=0x7fec28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.238+0000 7f4efa2bc700 1 Processor -- start 2022-03-21T13:54:35.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.238+0000 7f4efa2bc700 1 -- start start 2022-03-21T13:54:35.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4efa2bc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4ef40c20b0 0x7f4ef40bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4efa2bc700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4ef406c070 0x7f4ef40c3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4efa2bc700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef4154470 con 0x7f4ef40bd3a0 2022-03-21T13:54:35.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4efa2bc700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef406c4f0 con 0x7f4ef40c20b0 2022-03-21T13:54:35.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4efa2bc700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef40c3590 con 0x7f4ef406c070 2022-03-21T13:54:35.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4ef8ab9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4ef40c20b0 0x7f4ef40bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4ef8ab9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4ef40c20b0 0x7f4ef40bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56670/0 (socket says 172.21.15.160:56670) 2022-03-21T13:54:35.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4ef8ab9700 1 -- 172.21.15.160:0/716867633 learned_addr learned my addr 172.21.15.160:0/716867633 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f40037fe700 1 -- 172.21.15.160:0/3483837482 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40100037c0 con 0x7f401c06d450 2022-03-21T13:54:35.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4021bc0700 1 -- 172.21.15.160:0/3483837482 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c149f50 con 0x7f401c06d450 2022-03-21T13:54:35.325 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4ef9abb700 1 --2- 172.21.15.160:0/716867633 >> v2:172.21.15.171:3300/0 conn(0x7f4ef406c070 0x7f4ef40c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.325 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4ef9abb700 1 -- 172.21.15.160:0/716867633 >> v2:172.21.15.160:3300/0 conn(0x7f4ef40c20b0 msgr2=0x7f4ef40bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:35.325 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4ef9abb700 1 --2- 172.21.15.160:0/716867633 >> v2:172.21.15.160:3300/0 conn(0x7f4ef40c20b0 0x7f4ef40bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.326 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4ef9abb700 1 -- 172.21.15.160:0/716867633 >> v1:172.21.15.160:6789/0 conn(0x7f4ef40bd3a0 legacy=0x7f4ef406a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:35.326 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4ef9abb700 1 -- 172.21.15.160:0/716867633 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef4154750 con 0x7f4ef406c070 2022-03-21T13:54:35.326 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4ef9abb700 1 --2- 172.21.15.160:0/716867633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef406c070 0x7f4ef40c3050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40c2630 tx=0x7f4eec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a5c1bf440ef9576 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.327 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.240+0000 7f4ee3fff700 1 -- 172.21.15.160:0/716867633 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00e070 con 0x7f4ef406c070 2022-03-21T13:54:35.327 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.240+0000 7f4ee3fff700 1 -- 172.21.15.160:0/716867633 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec00bb20 con 0x7f4ef406c070 2022-03-21T13:54:35.327 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.240+0000 7f4ee3fff700 1 -- 172.21.15.160:0/716867633 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec003860 con 0x7f4ef406c070 2022-03-21T13:54:35.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f40037fe700 1 -- 172.21.15.160:0/3483837482 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4010003920 con 0x7f401c06d450 2022-03-21T13:54:35.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f4021bc0700 1 -- 172.21.15.160:0/3483837482 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c0bcdb0 con 0x7f401c06d450 2022-03-21T13:54:35.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.239+0000 7f40037fe700 1 -- 172.21.15.160:0/3483837482 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010003ce0 con 0x7f401c06d450 2022-03-21T13:54:35.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.240+0000 7f4021bc0700 1 -- 172.21.15.160:0/3483837482 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff8005130 con 0x7f401c06d450 2022-03-21T13:54:35.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.240+0000 7f4efa2bc700 1 -- 172.21.15.160:0/716867633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef406c070 msgr2=0x7f4ef40c3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.240+0000 7f4efa2bc700 1 --2- 172.21.15.160:0/716867633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef406c070 0x7f4ef40c3050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40c2630 tx=0x7f4eec009780 comp rx=0 tx=0).stop 2022-03-21T13:54:35.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.240+0000 7f4efa2bc700 1 -- 172.21.15.160:0/716867633 shutdown_connections 2022-03-21T13:54:35.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.240+0000 7f4efa2bc700 1 --2- 172.21.15.160:0/716867633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef406c070 0x7f4ef40c3050 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.240+0000 7f4efa2bc700 1 --2- 172.21.15.160:0/716867633 >> v2:172.21.15.160:3300/0 conn(0x7f4ef40c20b0 0x7f4ef40bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.240+0000 7f4efa2bc700 1 -- 172.21.15.160:0/716867633 >> 172.21.15.160:0/716867633 conn(0x7f4ef40c72d0 msgr2=0x7f4ef40c76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.241+0000 7f4efa2bc700 1 -- 172.21.15.160:0/716867633 shutdown_connections 2022-03-21T13:54:35.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.241+0000 7f4efa2bc700 1 -- 172.21.15.160:0/716867633 wait complete. 2022-03-21T13:54:35.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.242+0000 7f4efa2bc700 1 Processor -- start 2022-03-21T13:54:35.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.242+0000 7f4efa2bc700 1 -- start start 2022-03-21T13:54:35.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4efa2bc700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef406c070 0x7f4ef4149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4efa2bc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ef40bd3a0 0x7f4ef414aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4efa2bc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef40c20b0 0x7f4ef414b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4efa2bc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4165c30 con 0x7f4ef40bd3a0 2022-03-21T13:54:35.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4efa2bc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40b9730 con 0x7f4ef40c20b0 2022-03-21T13:54:35.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4efa2bc700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef414a040 con 0x7f4ef406c070 2022-03-21T13:54:35.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4ef92ba700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef406c070 0x7f4ef4149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4ef92ba700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef406c070 0x7f4ef4149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47070/0 (socket says 172.21.15.160:47070) 2022-03-21T13:54:35.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4ef92ba700 1 -- 172.21.15.160:0/580945667 learned_addr learned my addr 172.21.15.160:0/580945667 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:35.335 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7fec1ffff700 1 -- 172.21.15.160:0/2560774590 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fec2c051060 con 0x7fec380be460 2022-03-21T13:54:35.335 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4ef92ba700 1 -- 172.21.15.160:0/580945667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef40c20b0 msgr2=0x7f4ef414b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.335 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4ef92ba700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef40c20b0 0x7f4ef414b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.336 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4ef92ba700 1 -- 172.21.15.160:0/580945667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ef40bd3a0 msgr2=0x7f4ef414aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.336 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4ef92ba700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ef40bd3a0 0x7f4ef414aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.336 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4ef92ba700 1 -- 172.21.15.160:0/580945667 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec009a20 con 0x7f4ef406c070 2022-03-21T13:54:35.336 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.243+0000 7f4ef92ba700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef406c070 0x7f4ef4149630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400c490 tx=0x7f4ee4007dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.337 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.244+0000 7f40037fe700 1 -- 172.21.15.160:0/3483837482 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f401000f050 con 0x7f401c06d450 2022-03-21T13:54:35.337 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.244+0000 7f40037fe700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ffc063e30 0x7f3ffc0662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.244+0000 7f40037fe700 1 -- 172.21.15.160:0/3483837482 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4010082270 con 0x7f401c06d450 2022-03-21T13:54:35.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.245+0000 7f401b7fe700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ffc063e30 0x7f3ffc0662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.246+0000 7f401b7fe700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ffc063e30 0x7f3ffc0662e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f400c006fd0 tx=0x7f400c0090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.338 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.246+0000 7f40037fe700 1 -- 172.21.15.160:0/3483837482 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f4010050e60 con 0x7f401c06d450 2022-03-21T13:54:35.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.244+0000 7f4ee17fa700 1 -- 172.21.15.160:0/580945667 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40034c0 con 0x7f4ef406c070 2022-03-21T13:54:35.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.244+0000 7f4ee17fa700 1 -- 172.21.15.160:0/580945667 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee4003640 con 0x7f4ef406c070 2022-03-21T13:54:35.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.244+0000 7f4efa2bc700 1 -- 172.21.15.160:0/580945667 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef4165e80 con 0x7f4ef406c070 2022-03-21T13:54:35.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.244+0000 7f4efa2bc700 1 -- 172.21.15.160:0/580945667 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef40b93c0 con 0x7f4ef406c070 2022-03-21T13:54:35.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.245+0000 7f4ee17fa700 1 -- 172.21.15.160:0/580945667 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4003a00 con 0x7f4ef406c070 2022-03-21T13:54:35.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.245+0000 7f4ee17fa700 1 -- 172.21.15.160:0/580945667 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f4ee4019030 con 0x7f4ef406c070 2022-03-21T13:54:35.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.246+0000 7f4ee17fa700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4ed406c570 0x7f4ed406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:35.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.246+0000 7f4ee17fa700 1 -- 172.21.15.160:0/580945667 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ee407fc60 con 0x7f4ef406c070 2022-03-21T13:54:35.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.246+0000 7f4ef8ab9700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4ed406c570 0x7f4ed406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:35.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.246+0000 7f4ef8ab9700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4ed406c570 0x7f4ed406ea20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40be070 tx=0x7f4ef000a2b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:35.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.264+0000 7f4efa2bc700 1 -- 172.21.15.160:0/580945667 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed0005130 con 0x7f4ef406c070 2022-03-21T13:54:35.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.268+0000 7f4ee17fa700 1 -- 172.21.15.160:0/580945667 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f4ee404e770 con 0x7f4ef406c070 2022-03-21T13:54:35.591 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.589+0000 7f4021bc0700 1 -- 172.21.15.160:0/3483837482 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3ff80056b0 con 0x7f401c06d450 2022-03-21T13:54:35.592 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.590+0000 7f40037fe700 1 -- 172.21.15.160:0/3483837482 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4010015020 con 0x7f401c06d450 2022-03-21T13:54:35.594 INFO:teuthology.orchestra.run.smithi160.stdout:55834574852 2022-03-21T13:54:35.595 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.593+0000 7f4021bc0700 1 -- 172.21.15.160:0/3483837482 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ffc063e30 msgr2=0x7f3ffc0662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.596 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.593+0000 7f4021bc0700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ffc063e30 0x7f3ffc0662e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f400c006fd0 tx=0x7f400c0090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.596 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.593+0000 7f4021bc0700 1 -- 172.21.15.160:0/3483837482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c06d450 msgr2=0x7f401c0c6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.596 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.593+0000 7f4021bc0700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c06d450 0x7f401c0c6340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4010011c30 tx=0x7f4010017000 comp rx=0 tx=0).stop 2022-03-21T13:54:35.596 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.593+0000 7f4021bc0700 1 -- 172.21.15.160:0/3483837482 shutdown_connections 2022-03-21T13:54:35.596 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.593+0000 7f4021bc0700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3ffc063e30 0x7f3ffc0662e0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f400c006fd0 tx=0x7f400c0090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.597 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.593+0000 7f4021bc0700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f401c0c7890 0x7f401c149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.597 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.593+0000 7f4021bc0700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f401c06a010 0x7f401c145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.597 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.593+0000 7f4021bc0700 1 --2- 172.21.15.160:0/3483837482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c06d450 0x7f401c0c6340 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.597 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.593+0000 7f4021bc0700 1 -- 172.21.15.160:0/3483837482 >> 172.21.15.160:0/3483837482 conn(0x7f401c068620 msgr2=0x7f401c0bff40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.598 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.594+0000 7f4021bc0700 1 -- 172.21.15.160:0/3483837482 shutdown_connections 2022-03-21T13:54:35.598 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.594+0000 7f4021bc0700 1 -- 172.21.15.160:0/3483837482 wait complete. 2022-03-21T13:54:35.599 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.595+0000 7f789bb42700 1 -- 172.21.15.160:0/349397040 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7894070210 con 0x7f78940c35f0 2022-03-21T13:54:35.599 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.595+0000 7f7881ffb700 1 -- 172.21.15.160:0/349397040 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f788c054720 con 0x7f78940c35f0 2022-03-21T13:54:35.599 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.595+0000 7f3c69e71700 1 -- 172.21.15.160:0/253870121 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3c6405e2f0 con 0x7f3c64159db0 2022-03-21T13:54:35.600 INFO:teuthology.orchestra.run.smithi160.stdout:55834574852 2022-03-21T13:54:35.600 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.596+0000 7f3c4b7fe700 1 -- 172.21.15.160:0/253870121 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c58015020 con 0x7f3c64159db0 2022-03-21T13:54:35.601 INFO:teuthology.orchestra.run.smithi160.stdout:55834574852 2022-03-21T13:54:35.601 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.597+0000 7f194bf23700 1 -- 172.21.15.160:0/2888602161 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f194406fc00 con 0x7f19440c4b90 2022-03-21T13:54:35.602 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.597+0000 7f39ebe2d700 1 -- 172.21.15.160:0/3843860319 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f39e406fc00 con 0x7f39e4159970 2022-03-21T13:54:35.602 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.597+0000 7f39e1ffb700 1 -- 172.21.15.160:0/3843860319 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f39d0053360 con 0x7f39e4159970 2022-03-21T13:54:35.603 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.598+0000 7f1931ffb700 1 -- 172.21.15.160:0/2888602161 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1934017020 con 0x7f19440c4b90 2022-03-21T13:54:35.603 INFO:teuthology.orchestra.run.smithi160.stdout:55834574852 2022-03-21T13:54:35.604 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f789bb42700 1 -- 172.21.15.160:0/349397040 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7874063db0 msgr2=0x7f7874066260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.604 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f789bb42700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7874063db0 0x7f7874066260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7890006fd0 tx=0x7f7890006bb0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.604 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f789bb42700 1 -- 172.21.15.160:0/349397040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940c35f0 msgr2=0x7f7894150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.604 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f789bb42700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940c35f0 0x7f7894150230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f788c015000 tx=0x7f788c018000 comp rx=0 tx=0).stop 2022-03-21T13:54:35.605 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f3c69e71700 1 -- 172.21.15.160:0/253870121 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3c44063ce0 msgr2=0x7f3c44066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.606 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f3c69e71700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3c44063ce0 0x7f3c44066190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c54005750 tx=0x7f3c54007940 comp rx=0 tx=0).stop 2022-03-21T13:54:35.606 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f3c69e71700 1 -- 172.21.15.160:0/253870121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c64159db0 msgr2=0x7f3c641696d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.606 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f3c69e71700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c64159db0 0x7f3c641696d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800b410 tx=0x7f3c58006f50 comp rx=0 tx=0).stop 2022-03-21T13:54:35.606 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f3c69e71700 1 -- 172.21.15.160:0/253870121 shutdown_connections 2022-03-21T13:54:35.607 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f3c69e71700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3c44063ce0 0x7f3c44066190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.607 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f3c69e71700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c64159db0 0x7f3c641696d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.607 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f3c69e71700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c640c2ea0 0x7f3c6416ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.607 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f3c69e71700 1 --2- 172.21.15.160:0/253870121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c641599e0 0x7f3c640c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.607 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.599+0000 7f3c69e71700 1 -- 172.21.15.160:0/253870121 >> 172.21.15.160:0/253870121 conn(0x7f3c640c7f60 msgr2=0x7f3c640c0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.608 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.600+0000 7f3c69e71700 1 -- 172.21.15.160:0/253870121 shutdown_connections 2022-03-21T13:54:35.608 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.600+0000 7f3c69e71700 1 -- 172.21.15.160:0/253870121 wait complete. 2022-03-21T13:54:35.609 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.601+0000 7f789bb42700 1 -- 172.21.15.160:0/349397040 shutdown_connections 2022-03-21T13:54:35.609 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.601+0000 7f789bb42700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7874063db0 0x7f7874066260 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.609 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.601+0000 7f789bb42700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940c35f0 0x7f7894150230 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.609 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.601+0000 7f789bb42700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f789405dc80 0x7f789414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.610 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.601+0000 7f789bb42700 1 --2- 172.21.15.160:0/349397040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78940c2250 0x7f789414e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.610 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.601+0000 7f789bb42700 1 -- 172.21.15.160:0/349397040 >> 172.21.15.160:0/349397040 conn(0x7f78940c7f60 msgr2=0x7f789406b250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.610 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.601+0000 7f789bb42700 1 -- 172.21.15.160:0/349397040 shutdown_connections 2022-03-21T13:54:35.610 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.601+0000 7f789bb42700 1 -- 172.21.15.160:0/349397040 wait complete. 2022-03-21T13:54:35.611 INFO:teuthology.orchestra.run.smithi160.stdout:55834574852 2022-03-21T13:54:35.611 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 -- 172.21.15.160:0/2888602161 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1924063d60 msgr2=0x7f1924066210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.612 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1924063d60 0x7f1924066210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1940006fd0 tx=0x7f1940017000 comp rx=0 tx=0).stop 2022-03-21T13:54:35.612 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 -- 172.21.15.160:0/2888602161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19440c4b90 msgr2=0x7f19441581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.612 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19440c4b90 0x7f19441581e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f193400c490 tx=0x7f1934007d90 comp rx=0 tx=0).stop 2022-03-21T13:54:35.612 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 -- 172.21.15.160:0/2888602161 shutdown_connections 2022-03-21T13:54:35.613 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1924063d60 0x7f1924066210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.613 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19440c4f60 0x7f1944158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.613 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19440c36d0 0x7f194415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.613 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 --2- 172.21.15.160:0/2888602161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19440c4b90 0x7f19441581e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.614 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 -- 172.21.15.160:0/2888602161 >> 172.21.15.160:0/2888602161 conn(0x7f19440c98f0 msgr2=0x7f19440c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.614 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 -- 172.21.15.160:0/2888602161 shutdown_connections 2022-03-21T13:54:35.614 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.605+0000 7f194bf23700 1 -- 172.21.15.160:0/2888602161 wait complete. 2022-03-21T13:54:35.615 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.606+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2560774590 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fec380af0e0 con 0x7fec380be460 2022-03-21T13:54:35.615 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.607+0000 7fec1ffff700 1 -- 172.21.15.160:0/2560774590 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec380af0e0 con 0x7fec380be460 2022-03-21T13:54:35.615 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.610+0000 7f39ebe2d700 1 -- 172.21.15.160:0/3843860319 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f39cc063ce0 msgr2=0x7f39cc066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.616 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.610+0000 7f39ebe2d700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f39cc063ce0 0x7f39cc066190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009ab0 tx=0x7f39d8018000 comp rx=0 tx=0).stop 2022-03-21T13:54:35.616 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.610+0000 7f39ebe2d700 1 -- 172.21.15.160:0/3843860319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159970 msgr2=0x7f39e41324e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.616 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.610+0000 7f39ebe2d700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159970 0x7f39e41324e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f39d000e900 tx=0x7f39d0009060 comp rx=0 tx=0).stop 2022-03-21T13:54:35.616 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.610+0000 7f51f405d700 1 -- 172.21.15.160:0/1461850279 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f51ec06fc00 con 0x7f51ec1444d0 2022-03-21T13:54:35.617 INFO:teuthology.orchestra.run.smithi160.stdout:55834574852 2022-03-21T13:54:35.617 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.611+0000 7f51d9ffb700 1 -- 172.21.15.160:0/1461850279 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51e8017020 con 0x7f51ec1444d0 2022-03-21T13:54:35.618 INFO:teuthology.orchestra.run.smithi160.stdout:55834574852 2022-03-21T13:54:35.619 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.613+0000 7f39ebe2d700 1 -- 172.21.15.160:0/3843860319 shutdown_connections 2022-03-21T13:54:35.619 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.613+0000 7f39ebe2d700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f39cc063ce0 0x7f39cc066190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.619 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.613+0000 7f39ebe2d700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e4159d40 0x7f39e4132a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.619 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.613+0000 7f39ebe2d700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39e406d840 0x7f39e414b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.620 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.613+0000 7f39ebe2d700 1 --2- 172.21.15.160:0/3843860319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39e4159970 0x7f39e41324e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.620 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.613+0000 7f39ebe2d700 1 -- 172.21.15.160:0/3843860319 >> 172.21.15.160:0/3843860319 conn(0x7f39e40c3fc0 msgr2=0x7f39e40bf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.620 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.614+0000 7f39ebe2d700 1 -- 172.21.15.160:0/3843860319 shutdown_connections 2022-03-21T13:54:35.620 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.614+0000 7f39ebe2d700 1 -- 172.21.15.160:0/3843860319 wait complete. 2022-03-21T13:54:35.621 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.615+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2560774590 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec18063ce0 msgr2=0x7fec18066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.621 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.615+0000 7fec3e6a8700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec18063ce0 0x7fec18066190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec28001c70 tx=0x7fec28009040 comp rx=0 tx=0).stop 2022-03-21T13:54:35.621 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.615+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2560774590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec380be460 msgr2=0x7fec380af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.621 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.615+0000 7fec3e6a8700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec380be460 0x7fec380af760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fec2c015000 tx=0x7fec2c016000 comp rx=0 tx=0).stop 2022-03-21T13:54:35.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2022-03-21T13:54:35.623 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.615+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2560774590 shutdown_connections 2022-03-21T13:54:35.623 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.615+0000 7fec3e6a8700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec18063ce0 0x7fec18066190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.624 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.615+0000 7fec3e6a8700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec380c7890 0x7fec380afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.624 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.615+0000 7fec3e6a8700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3806a100 0x7fec38165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.624 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.615+0000 7fec3e6a8700 1 --2- 172.21.15.160:0/2560774590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec380be460 0x7fec380af760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.624 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.615+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2560774590 >> 172.21.15.160:0/2560774590 conn(0x7fec38068620 msgr2=0x7fec380c4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.625 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.616+0000 7f51f405d700 1 -- 172.21.15.160:0/1461850279 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f51cc063d10 msgr2=0x7f51cc0661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.625 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.616+0000 7f51f405d700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f51cc063d10 0x7f51cc0661c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f51e40093f0 tx=0x7f51e400b040 comp rx=0 tx=0).stop 2022-03-21T13:54:35.625 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.616+0000 7f51f405d700 1 -- 172.21.15.160:0/1461850279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51ec1444d0 msgr2=0x7f51ec0c1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.626 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.616+0000 7f51f405d700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51ec1444d0 0x7f51ec0c1140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c410 tx=0x7f51e8007b60 comp rx=0 tx=0).stop 2022-03-21T13:54:35.626 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.618+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2560774590 shutdown_connections 2022-03-21T13:54:35.627 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.618+0000 7fec3e6a8700 1 -- 172.21.15.160:0/2560774590 wait complete. 2022-03-21T13:54:35.627 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.620+0000 7f51f405d700 1 -- 172.21.15.160:0/1461850279 shutdown_connections 2022-03-21T13:54:35.627 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.620+0000 7f51f405d700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f51cc063d10 0x7f51cc0661c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.628 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.620+0000 7f51f405d700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51ec1444d0 0x7f51ec0c1140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.628 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.620+0000 7f51f405d700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51ec0c45d0 0x7f51ec1613b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.628 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.620+0000 7f51f405d700 1 --2- 172.21.15.160:0/1461850279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec0c49a0 0x7f51ec146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.628 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.620+0000 7f51f405d700 1 -- 172.21.15.160:0/1461850279 >> 172.21.15.160:0/1461850279 conn(0x7f51ec068650 msgr2=0x7f51ec0ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.629 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.620+0000 7f51f405d700 1 -- 172.21.15.160:0/1461850279 shutdown_connections 2022-03-21T13:54:35.629 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.620+0000 7f51f405d700 1 -- 172.21.15.160:0/1461850279 wait complete. 2022-03-21T13:54:35.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2022-03-21T13:54:35.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2022-03-21T13:54:35.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2022-03-21T13:54:35.634 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.633+0000 7f4efa2bc700 1 -- 172.21.15.160:0/580945667 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4ed00053e0 con 0x7f4ef406c070 2022-03-21T13:54:35.635 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.633+0000 7f4ee17fa700 1 -- 172.21.15.160:0/580945667 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ee4051d90 con 0x7f4ef406c070 2022-03-21T13:54:35.635 INFO:teuthology.orchestra.run.smithi160.stdout:55834574852 2022-03-21T13:54:35.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2022-03-21T13:54:35.638 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 -- 172.21.15.160:0/580945667 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4ed406c570 msgr2=0x7f4ed406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.638 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4ed406c570 0x7f4ed406ea20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40be070 tx=0x7f4ef000a2b0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.638 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 -- 172.21.15.160:0/580945667 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef406c070 msgr2=0x7f4ef4149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:35.639 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef406c070 0x7f4ef4149630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400c490 tx=0x7f4ee4007dc0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.639 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 -- 172.21.15.160:0/580945667 shutdown_connections 2022-03-21T13:54:35.639 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4ed406c570 0x7f4ed406ea20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.639 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef40c20b0 0x7f4ef414b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.640 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef406c070 0x7f4ef4149630 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.640 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 --2- 172.21.15.160:0/580945667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ef40bd3a0 0x7f4ef414aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:35.640 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 -- 172.21.15.160:0/580945667 >> 172.21.15.160:0/580945667 conn(0x7f4ef40c72d0 msgr2=0x7f4ef40c2660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:35.640 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 -- 172.21.15.160:0/580945667 shutdown_connections 2022-03-21T13:54:35.640 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:35.636+0000 7f4efa2bc700 1 -- 172.21.15.160:0/580945667 wait complete. 2022-03-21T13:54:35.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2022-03-21T13:54:35.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2022-03-21T13:54:35.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2022-03-21T13:54:36.288 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:54:36.291 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:54:36.623 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-03-21T13:54:36.631 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-03-21T13:54:36.632 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-03-21T13:54:36.633 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-03-21T13:54:36.638 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-03-21T13:54:36.642 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-03-21T13:54:36.644 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-03-21T13:54:36.651 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-03-21T13:54:36.806 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.798+0000 7fc32359e700 1 Processor -- start 2022-03-21T13:54:36.806 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.798+0000 7fc32359e700 1 -- start start 2022-03-21T13:54:36.807 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.799+0000 7fc32359e700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc324067960 0x7fc324159850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.807 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.799+0000 7fc32359e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc32406b2d0 0x7fc32406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.807 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.799+0000 7fc32359e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32406cf40 con 0x7fc324067d30 2022-03-21T13:54:36.807 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.799+0000 7fc32359e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc324159d90 con 0x7fc32406b2d0 2022-03-21T13:54:36.807 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.799+0000 7fc32359e700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32406c070 con 0x7fc324067960 2022-03-21T13:54:36.808 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.800+0000 7fc321d9b700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fc324067d30 0x7fc32406abc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59838/0 (socket says 172.21.15.160:59838) 2022-03-21T13:54:36.808 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.800+0000 7fc321d9b700 1 -- 172.21.15.160:0/1781424230 learned_addr learned my addr 172.21.15.160:0/1781424230 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:36.808 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.800+0000 7fc322d9d700 1 --2- 172.21.15.160:0/1781424230 >> v2:172.21.15.160:3300/0 conn(0x7fc32406b2d0 0x7fc32406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.808 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.801+0000 7fc322d9d700 1 -- 172.21.15.160:0/1781424230 >> v2:172.21.15.171:3300/0 conn(0x7fc324067960 msgr2=0x7fc324159850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-03-21T13:54:36.809 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.801+0000 7fc322d9d700 1 --2- 172.21.15.160:0/1781424230 >> v2:172.21.15.171:3300/0 conn(0x7fc324067960 0x7fc324159850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.809 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.801+0000 7fc322d9d700 1 -- 172.21.15.160:0/1781424230 >> v1:172.21.15.160:6789/0 conn(0x7fc324067d30 legacy=0x7fc32406abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.809 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.801+0000 7fc322d9d700 1 -- 172.21.15.160:0/1781424230 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32406d9c0 con 0x7fc32406b2d0 2022-03-21T13:54:36.809 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.801+0000 7fc322d9d700 1 --2- 172.21.15.160:0/1781424230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc32406b2d0 0x7fc32406d480 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc324069520 tx=0x7fc31c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d034d3273b0724 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.810 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.801+0000 7fc32159a700 1 -- 172.21.15.160:0/1781424230 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00e070 con 0x7fc32406b2d0 2022-03-21T13:54:36.810 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.801+0000 7fc32159a700 1 -- 172.21.15.160:0/1781424230 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c00bc30 con 0x7fc32406b2d0 2022-03-21T13:54:36.810 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.801+0000 7fc32159a700 1 -- 172.21.15.160:0/1781424230 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c012430 con 0x7fc32406b2d0 2022-03-21T13:54:36.810 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.802+0000 7fc32359e700 1 -- 172.21.15.160:0/1781424230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc32406b2d0 msgr2=0x7fc32406d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.810 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.802+0000 7fc32359e700 1 --2- 172.21.15.160:0/1781424230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc32406b2d0 0x7fc32406d480 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc324069520 tx=0x7fc31c009780 comp rx=0 tx=0).stop 2022-03-21T13:54:36.811 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.803+0000 7fc32359e700 1 -- 172.21.15.160:0/1781424230 shutdown_connections 2022-03-21T13:54:36.811 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.803+0000 7fc32359e700 1 --2- 172.21.15.160:0/1781424230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc32406b2d0 0x7fc32406d480 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.811 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.803+0000 7fc32359e700 1 --2- 172.21.15.160:0/1781424230 >> v2:172.21.15.171:3300/0 conn(0x7fc324067960 0x7fc324159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.811 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.803+0000 7fc32359e700 1 -- 172.21.15.160:0/1781424230 >> 172.21.15.160:0/1781424230 conn(0x7fc3240c6a50 msgr2=0x7fc3240c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:36.811 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.803+0000 7fc32359e700 1 -- 172.21.15.160:0/1781424230 shutdown_connections 2022-03-21T13:54:36.814 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.803+0000 7fc32359e700 1 -- 172.21.15.160:0/1781424230 wait complete. 2022-03-21T13:54:36.814 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.805+0000 7fc32359e700 1 Processor -- start 2022-03-21T13:54:36.814 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.805+0000 7fc32359e700 1 -- start start 2022-03-21T13:54:36.815 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.806+0000 7fc32359e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324067960 0x7fc324143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.815 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.806+0000 7fc32359e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc324067d30 0x7fc324144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.815 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.806+0000 7fc32359e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc32406b2d0 0x7fc324144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.815 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.806+0000 7fc32359e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240bc560 con 0x7fc324067960 2022-03-21T13:54:36.816 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.806+0000 7fc32359e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc324149870 con 0x7fc324067d30 2022-03-21T13:54:36.816 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.806+0000 7fc32359e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc324158f10 con 0x7fc32406b2d0 2022-03-21T13:54:36.816 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.806+0000 7fc32259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324067960 0x7fc324143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.817 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.806+0000 7fc32259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324067960 0x7fc324143550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56690/0 (socket says 172.21.15.160:56690) 2022-03-21T13:54:36.817 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.806+0000 7fc32259c700 1 -- 172.21.15.160:0/1115797404 learned_addr learned my addr 172.21.15.160:0/1115797404 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.817 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.807+0000 7fc322d9d700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc32406b2d0 0x7fc324144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.817 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.807+0000 7fc321d9b700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc324067d30 0x7fc324144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.818 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.807+0000 7fc32259c700 1 -- 172.21.15.160:0/1115797404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc32406b2d0 msgr2=0x7fc324144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.818 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.807+0000 7fc32259c700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc32406b2d0 0x7fc324144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.818 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.807+0000 7fc32259c700 1 -- 172.21.15.160:0/1115797404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc324067d30 msgr2=0x7fc324144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.818 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.807+0000 7fc32259c700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc324067d30 0x7fc324144a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.818 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.807+0000 7fc32259c700 1 -- 172.21.15.160:0/1115797404 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c009a20 con 0x7fc324067960 2022-03-21T13:54:36.819 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.807+0000 7fc32259c700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324067960 0x7fc324143550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc31400b4c0 tx=0x7fc314009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.819 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.808+0000 7fc31a7fc700 1 -- 172.21.15.160:0/1115797404 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314011630 con 0x7fc324067960 2022-03-21T13:54:36.819 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.808+0000 7fc31a7fc700 1 -- 172.21.15.160:0/1115797404 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3140117b0 con 0x7fc324067960 2022-03-21T13:54:36.819 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.808+0000 7fc31a7fc700 1 -- 172.21.15.160:0/1115797404 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314011b70 con 0x7fc324067960 2022-03-21T13:54:36.820 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.808+0000 7fc32359e700 1 -- 172.21.15.160:0/1115797404 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc324148980 con 0x7fc324067960 2022-03-21T13:54:36.820 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.808+0000 7fc32359e700 1 -- 172.21.15.160:0/1115797404 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc324148f40 con 0x7fc324067960 2022-03-21T13:54:36.820 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.811+0000 7fc31a7fc700 1 -- 172.21.15.160:0/1115797404 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fc314021070 con 0x7fc324067960 2022-03-21T13:54:36.820 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.812+0000 7fc31a7fc700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fc30c063fa0 0x7fc30c066450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.821 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.812+0000 7fc31a7fc700 1 -- 172.21.15.160:0/1115797404 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc314080730 con 0x7fc324067960 2022-03-21T13:54:36.821 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.813+0000 7fc32359e700 1 -- 172.21.15.160:0/1115797404 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc304005130 con 0x7fc324067960 2022-03-21T13:54:36.822 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.815+0000 7fc321d9b700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fc30c063fa0 0x7fc30c066450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.822 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.815+0000 7fc321d9b700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fc30c063fa0 0x7fc30c066450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc32406d7e0 tx=0x7fc310009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.828 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.822+0000 7fc31a7fc700 1 -- 172.21.15.160:0/1115797404 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fc314015080 con 0x7fc324067960 2022-03-21T13:54:36.860 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.858+0000 7fee6db50700 1 Processor -- start 2022-03-21T13:54:36.860 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.858+0000 7fee6db50700 1 -- start start 2022-03-21T13:54:36.862 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.859+0000 7fee6db50700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 0x7fee680c4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.862 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.859+0000 7fee6db50700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fee68068ca0 0x7fee6806c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.862 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.859+0000 7fee6db50700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee68068810 con 0x7fee68159740 2022-03-21T13:54:36.863 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee6db50700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee680679f0 con 0x7fee68068ca0 2022-03-21T13:54:36.863 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee6db50700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee68067c00 con 0x7fee680c3040 2022-03-21T13:54:36.863 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee6cb4e700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fee68159740 0x7fee680c1ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:52938/0 (socket says 172.21.15.160:52938) 2022-03-21T13:54:36.863 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee67fff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 0x7fee680c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee6cb4e700 1 -- 172.21.15.160:0/1086961211 learned_addr learned my addr 172.21.15.160:0/1086961211 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:36.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee6d34f700 1 --2- 172.21.15.160:0/1086961211 >> v2:172.21.15.171:3300/0 conn(0x7fee68068ca0 0x7fee6806c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee677fe700 1 -- 172.21.15.160:0/1086961211 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460927855 0 0) 0x7fee68068810 con 0x7fee68159740 2022-03-21T13:54:36.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee677fe700 1 -- 172.21.15.160:0/1086961211 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee540033f0 con 0x7fee68159740 2022-03-21T13:54:36.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee6d34f700 1 -- 172.21.15.160:0/1086961211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 msgr2=0x7fee680c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:36.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee6d34f700 1 --2- 172.21.15.160:0/1086961211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 0x7fee680c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee6d34f700 1 -- 172.21.15.160:0/1086961211 >> v1:172.21.15.171:6789/0 conn(0x7fee68159740 legacy=0x7fee680c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.860+0000 7fee6d34f700 1 -- 172.21.15.160:0/1086961211 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee68067ee0 con 0x7fee68068ca0 2022-03-21T13:54:36.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.861+0000 7fee6d34f700 1 --2- 172.21.15.160:0/1086961211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee68068ca0 0x7fee6806c350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee60009e90 tx=0x7fee60009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdfaad2eb117eca6 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.867 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.861+0000 7fee677fe700 1 -- 172.21.15.160:0/1086961211 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000e070 con 0x7fee68068ca0 2022-03-21T13:54:36.867 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.861+0000 7fee677fe700 1 -- 172.21.15.160:0/1086961211 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6000bb40 con 0x7fee68068ca0 2022-03-21T13:54:36.867 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.861+0000 7fee677fe700 1 -- 172.21.15.160:0/1086961211 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60012430 con 0x7fee68068ca0 2022-03-21T13:54:36.867 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.862+0000 7fee6db50700 1 -- 172.21.15.160:0/1086961211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee68068ca0 msgr2=0x7fee6806c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.868 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.862+0000 7fee6db50700 1 --2- 172.21.15.160:0/1086961211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee68068ca0 0x7fee6806c350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee60009e90 tx=0x7fee60009780 comp rx=0 tx=0).stop 2022-03-21T13:54:36.868 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.862+0000 7fee6db50700 1 -- 172.21.15.160:0/1086961211 shutdown_connections 2022-03-21T13:54:36.868 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.862+0000 7fee6db50700 1 --2- 172.21.15.160:0/1086961211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee68068ca0 0x7fee6806c350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.868 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.862+0000 7fee6db50700 1 --2- 172.21.15.160:0/1086961211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 0x7fee680c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.869 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.862+0000 7fee6db50700 1 -- 172.21.15.160:0/1086961211 >> 172.21.15.160:0/1086961211 conn(0x7fee680c7dc0 msgr2=0x7fee680c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:36.869 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.863+0000 7fee6db50700 1 -- 172.21.15.160:0/1086961211 shutdown_connections 2022-03-21T13:54:36.869 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.863+0000 7f4a2d0e2700 1 Processor -- start 2022-03-21T13:54:36.870 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.863+0000 7fee6db50700 1 -- 172.21.15.160:0/1086961211 wait complete. 2022-03-21T13:54:36.870 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.864+0000 7fee6db50700 1 Processor -- start 2022-03-21T13:54:36.871 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.863+0000 7f4a2d0e2700 1 -- start start 2022-03-21T13:54:36.871 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.864+0000 7f4a2d0e2700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4a281598e0 0x7f4a280c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.864+0000 7f4a2d0e2700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a28068f90 0x7f4a280c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.864+0000 7f4a2d0e2700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2806cb20 con 0x7f4a28159cb0 2022-03-21T13:54:36.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.864+0000 7f4a2d0e2700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2806d380 con 0x7f4a281598e0 2022-03-21T13:54:36.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.864+0000 7f4a2d0e2700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280c22c0 con 0x7f4a28068f90 2022-03-21T13:54:36.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a1e59c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a28068f90 0x7f4a280c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.873 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a1e59c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a28068f90 0x7f4a280c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47100/0 (socket says 172.21.15.160:47100) 2022-03-21T13:54:36.873 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a1e59c700 1 -- 172.21.15.160:0/1504321008 learned_addr learned my addr 172.21.15.160:0/1504321008 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.873 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a26d9d700 1 --2- 172.21.15.160:0/1504321008 >> v2:172.21.15.171:3300/0 conn(0x7f4a281598e0 0x7f4a280c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.873 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a1e59c700 1 -- 172.21.15.160:0/1504321008 >> v2:172.21.15.171:3300/0 conn(0x7f4a281598e0 msgr2=0x7f4a280c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:36.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a1e59c700 1 --2- 172.21.15.160:0/1504321008 >> v2:172.21.15.171:3300/0 conn(0x7f4a281598e0 0x7f4a280c46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a1e59c700 1 -- 172.21.15.160:0/1504321008 >> v1:172.21.15.160:6789/0 conn(0x7f4a28159cb0 legacy=0x7f4a28067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a1e59c700 1 -- 172.21.15.160:0/1504321008 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2806cdc0 con 0x7f4a28068f90 2022-03-21T13:54:36.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a1e59c700 1 --2- 172.21.15.160:0/1504321008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a28068f90 0x7f4a280c26e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a10006fd0 tx=0x7f4a100090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b394bfcd072dc1f server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.875 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7fee6db50700 1 -- start start 2022-03-21T13:54:36.875 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f029ef58700 1 Processor -- start 2022-03-21T13:54:36.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee6db50700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee68068ca0 0x7fee680b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee6db50700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 0x7fee68152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee6db50700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee68159740 0x7fee68151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.878 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee6db50700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68155820 con 0x7fee68068ca0 2022-03-21T13:54:36.878 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee6db50700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6816bea0 con 0x7fee68159740 2022-03-21T13:54:36.878 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee6db50700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6816c740 con 0x7fee680c3040 2022-03-21T13:54:36.878 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee6d34f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee68159740 0x7fee68151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.879 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee67fff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 0x7fee68152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.879 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee67fff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 0x7fee68152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47108/0 (socket says 172.21.15.160:47108) 2022-03-21T13:54:36.879 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee67fff700 1 -- 172.21.15.160:0/3307012834 learned_addr learned my addr 172.21.15.160:0/3307012834 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.879 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee6cb4e700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee68068ca0 0x7fee680b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.880 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee67fff700 1 -- 172.21.15.160:0/3307012834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee68159740 msgr2=0x7fee68151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.880 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee67fff700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee68159740 0x7fee68151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.880 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7fee67fff700 1 -- 172.21.15.160:0/3307012834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee68068ca0 msgr2=0x7fee680b8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.880 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.867+0000 7fee67fff700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee68068ca0 0x7fee680b8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.880 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.867+0000 7fee67fff700 1 -- 172.21.15.160:0/3307012834 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60009a20 con 0x7fee680c3040 2022-03-21T13:54:36.881 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a2659c700 1 -- 172.21.15.160:0/1504321008 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10004030 con 0x7f4a28068f90 2022-03-21T13:54:36.881 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a2659c700 1 -- 172.21.15.160:0/1504321008 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10004190 con 0x7f4a28068f90 2022-03-21T13:54:36.882 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.865+0000 7f4a2659c700 1 -- 172.21.15.160:0/1504321008 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10011630 con 0x7f4a28068f90 2022-03-21T13:54:36.882 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1504321008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a28068f90 msgr2=0x7f4a280c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.882 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.866+0000 7f4a2d0e2700 1 --2- 172.21.15.160:0/1504321008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a28068f90 0x7f4a280c26e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a10006fd0 tx=0x7f4a100090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.882 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.867+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1504321008 shutdown_connections 2022-03-21T13:54:36.883 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.867+0000 7f4a2d0e2700 1 --2- 172.21.15.160:0/1504321008 >> v2:172.21.15.171:3300/0 conn(0x7f4a281598e0 0x7f4a280c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.883 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.867+0000 7f4a2d0e2700 1 --2- 172.21.15.160:0/1504321008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a28068f90 0x7f4a280c26e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.883 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.867+0000 7fee6cb4e700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee68068ca0 0x7fee680b8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:54:36.884 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.867+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1504321008 >> 172.21.15.160:0/1504321008 conn(0x7f4a280c7f60 msgr2=0x7f4a280c3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:36.884 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.867+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1504321008 shutdown_connections 2022-03-21T13:54:36.885 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.867+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1504321008 wait complete. 2022-03-21T13:54:36.885 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.868+0000 7fee67fff700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 0x7fee68152a40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00e960 tx=0x7fee5c009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.886 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.868+0000 7fee64ff9700 1 -- 172.21.15.160:0/3307012834 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c013680 con 0x7fee680c3040 2022-03-21T13:54:36.886 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.868+0000 7fee64ff9700 1 -- 172.21.15.160:0/3307012834 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c0137e0 con 0x7fee680c3040 2022-03-21T13:54:36.886 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.868+0000 7fee6db50700 1 -- 172.21.15.160:0/3307012834 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee680b7eb0 con 0x7fee680c3040 2022-03-21T13:54:36.886 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.868+0000 7fee6db50700 1 -- 172.21.15.160:0/3307012834 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6816c0f0 con 0x7fee680c3040 2022-03-21T13:54:36.887 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.868+0000 7fee64ff9700 1 -- 172.21.15.160:0/3307012834 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c013b60 con 0x7fee680c3040 2022-03-21T13:54:36.887 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.868+0000 7f4a2d0e2700 1 Processor -- start 2022-03-21T13:54:36.888 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.868+0000 7fa1445cb700 1 Processor -- start 2022-03-21T13:54:36.888 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.868+0000 7fa1445cb700 1 -- start start 2022-03-21T13:54:36.888 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7fee64ff9700 1 -- 172.21.15.160:0/3307012834 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fee5c023070 con 0x7fee680c3040 2022-03-21T13:54:36.889 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.869+0000 7fa1445cb700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa13c0ba6d0 0x7fa13c06a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.889 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.869+0000 7fa1445cb700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.869+0000 7fa1445cb700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13c06ad00 con 0x7fa13c06b190 2022-03-21T13:54:36.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.869+0000 7fa1445cb700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13c0c3140 con 0x7fa13c0ba6d0 2022-03-21T13:54:36.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.869+0000 7fa1445cb700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c06d250 con 0x7fa13c06ca80 2022-03-21T13:54:36.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.869+0000 7fa141b66700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.891 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7fa141b66700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47112/0 (socket says 172.21.15.160:47112) 2022-03-21T13:54:36.891 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7fa141b66700 1 -- 172.21.15.160:0/3035272928 learned_addr learned my addr 172.21.15.160:0/3035272928 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.891 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.869+0000 7f4a2d0e2700 1 -- start start 2022-03-21T13:54:36.892 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7fa141b66700 1 -- 172.21.15.160:0/3035272928 >> v2:172.21.15.171:3300/0 conn(0x7fa13c0ba6d0 msgr2=0x7fa13c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:36.892 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7fa141b66700 1 --2- 172.21.15.160:0/3035272928 >> v2:172.21.15.171:3300/0 conn(0x7fa13c0ba6d0 0x7fa13c06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.892 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7fa141b66700 1 -- 172.21.15.160:0/3035272928 >> v1:172.21.15.171:6789/0 conn(0x7fa13c06b190 legacy=0x7fa13c154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:36.893 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7fa141b66700 1 -- 172.21.15.160:0/3035272928 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c06d530 con 0x7fa13c06ca80 2022-03-21T13:54:36.893 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7fee64ff9700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee48063d10 0x7fee480661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.893 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7fee6db50700 1 -- 172.21.15.160:0/3307012834 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6804b760 con 0x7fee680c3040 2022-03-21T13:54:36.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7f4a2d0e2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a28068f90 0x7f4a280b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7f4a2d0e2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a281598e0 0x7f4a28136730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7f4a2d0e2700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a28159cb0 0x7f4a28136c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7f4a2d0e2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280b67e0 con 0x7f4a281598e0 2022-03-21T13:54:36.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7f4a2d0e2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a281362a0 con 0x7f4a28068f90 2022-03-21T13:54:36.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7f4a2d0e2700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28139280 con 0x7f4a28159cb0 2022-03-21T13:54:36.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7fa141b66700 1 --2- 172.21.15.160:0/3035272928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c06b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa12c006fd0 tx=0x7fa12c0119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50bb694fbd1178e3 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.870+0000 7fee64ff9700 1 -- 172.21.15.160:0/3307012834 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee5c080b70 con 0x7fee680c3040 2022-03-21T13:54:36.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7fa141365700 1 -- 172.21.15.160:0/3035272928 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c016070 con 0x7fa13c06ca80 2022-03-21T13:54:36.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7fa141365700 1 -- 172.21.15.160:0/3035272928 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c013de0 con 0x7fa13c06ca80 2022-03-21T13:54:36.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7fa141365700 1 -- 172.21.15.160:0/3035272928 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c011320 con 0x7fa13c06ca80 2022-03-21T13:54:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7f4a26d9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a28068f90 0x7f4a280b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7f4a1e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a281598e0 0x7f4a28136730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7f4a26d9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a28068f90 0x7f4a280b62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59662/0 (socket says 172.21.15.160:59662) 2022-03-21T13:54:36.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7f4a26d9d700 1 -- 172.21.15.160:0/1289601147 learned_addr learned my addr 172.21.15.160:0/1289601147 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7f4a26d9d700 1 -- 172.21.15.160:0/1289601147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a28159cb0 msgr2=0x7f4a28136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7f4a26d9d700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a28159cb0 0x7f4a28136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.900 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7f4a26d9d700 1 -- 172.21.15.160:0/1289601147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a281598e0 msgr2=0x7f4a28136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.900 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7f4a26d9d700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a281598e0 0x7f4a28136730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.900 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7f4a26d9d700 1 -- 172.21.15.160:0/1289601147 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10009370 con 0x7f4a28068f90 2022-03-21T13:54:36.900 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7f4a1e59c700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a281598e0 0x7f4a28136730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:36.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7f4a26d9d700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a28068f90 0x7f4a280b62a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800cfc0 tx=0x7f4a180078b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7fa1445cb700 1 -- 172.21.15.160:0/3035272928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 msgr2=0x7fa13c0c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.871+0000 7fa1445cb700 1 --2- 172.21.15.160:0/3035272928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c06b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa12c006fd0 tx=0x7fa12c0119b0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.872+0000 7f4a1f7fe700 1 -- 172.21.15.160:0/1289601147 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800ae40 con 0x7f4a28068f90 2022-03-21T13:54:36.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.872+0000 7f4a1f7fe700 1 -- 172.21.15.160:0/1289601147 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18003860 con 0x7f4a28068f90 2022-03-21T13:54:36.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.872+0000 7f4a1f7fe700 1 -- 172.21.15.160:0/1289601147 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18003c20 con 0x7f4a28068f90 2022-03-21T13:54:36.903 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.872+0000 7fee6cb4e700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee48063d10 0x7fee480661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.903 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.872+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1289601147 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a28139520 con 0x7f4a28068f90 2022-03-21T13:54:36.904 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.872+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1289601147 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a28135310 con 0x7f4a28068f90 2022-03-21T13:54:36.904 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.872+0000 7fee6cb4e700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee48063d10 0x7fee480661c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee58005750 tx=0x7fee58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.872+0000 7f029ef58700 1 -- start start 2022-03-21T13:54:36.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.873+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1289601147 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a28134e90 con 0x7f4a28068f90 2022-03-21T13:54:36.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.873+0000 7fa1445cb700 1 -- 172.21.15.160:0/3035272928 shutdown_connections 2022-03-21T13:54:36.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.873+0000 7fa1445cb700 1 --2- 172.21.15.160:0/3035272928 >> v2:172.21.15.171:3300/0 conn(0x7fa13c0ba6d0 0x7fa13c06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.873+0000 7fa1445cb700 1 --2- 172.21.15.160:0/3035272928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c06b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.873+0000 7fa1445cb700 1 -- 172.21.15.160:0/3035272928 >> 172.21.15.160:0/3035272928 conn(0x7fa13c068620 msgr2=0x7fa13c0c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:36.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f4a1f7fe700 1 -- 172.21.15.160:0/1289601147 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f4a18004230 con 0x7f4a28068f90 2022-03-21T13:54:36.908 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029ef58700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f02980bef40 0x7f029806c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.908 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029ef58700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f02981526c0 0x7f02980c2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.908 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029ef58700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029806c720 con 0x7f02981522f0 2022-03-21T13:54:36.908 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029ef58700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029806dae0 con 0x7f02981526c0 2022-03-21T13:54:36.909 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029ef58700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029806ca00 con 0x7f02980bef40 2022-03-21T13:54:36.909 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7fa1445cb700 1 -- 172.21.15.160:0/3035272928 shutdown_connections 2022-03-21T13:54:36.910 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029d4f5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f02981526c0 0x7f02980c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.910 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029ccf4700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f02981522f0 0x7f0298068b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:52970/0 (socket says 172.21.15.160:52970) 2022-03-21T13:54:36.910 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029ccf4700 1 -- 172.21.15.160:0/3328162716 learned_addr learned my addr 172.21.15.160:0/3328162716 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:36.910 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029d4f5700 1 --2- 172.21.15.160:0/3328162716 >> v2:172.21.15.160:3300/0 conn(0x7f02981526c0 0x7f02980c2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56732/0 (socket says 172.21.15.160:56732) 2022-03-21T13:54:36.911 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f4a1f7fe700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4a0c063ce0 0x7f4a0c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.911 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f4a1f7fe700 1 -- 172.21.15.160:0/1289601147 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4a18012070 con 0x7f4a28068f90 2022-03-21T13:54:36.911 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029d4f5700 1 -- 172.21.15.160:0/3328162716 >> v2:172.21.15.171:3300/0 conn(0x7f02980bef40 msgr2=0x7f029806c070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-03-21T13:54:36.912 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029d4f5700 1 --2- 172.21.15.160:0/3328162716 >> v2:172.21.15.171:3300/0 conn(0x7f02980bef40 0x7f029806c070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.912 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029d4f5700 1 -- 172.21.15.160:0/3328162716 >> v1:172.21.15.171:6789/0 conn(0x7f02981522f0 legacy=0x7f0298068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.912 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7f029d4f5700 1 -- 172.21.15.160:0/3328162716 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029806d420 con 0x7f02981526c0 2022-03-21T13:54:36.913 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.874+0000 7fa1445cb700 1 -- 172.21.15.160:0/3035272928 wait complete. 2022-03-21T13:54:36.913 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.875+0000 7f029d4f5700 1 --2- 172.21.15.160:0/3328162716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02981526c0 0x7f02980c2600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f02980bbb10 tx=0x7f0290009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9132d8ff7dbfd8d6 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.914 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.875+0000 7f02977fe700 1 -- 172.21.15.160:0/3328162716 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029000e070 con 0x7f02981526c0 2022-03-21T13:54:36.914 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.875+0000 7f02977fe700 1 -- 172.21.15.160:0/3328162716 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029000bcc0 con 0x7f02981526c0 2022-03-21T13:54:36.914 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.875+0000 7f02977fe700 1 -- 172.21.15.160:0/3328162716 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290012680 con 0x7f02981526c0 2022-03-21T13:54:36.915 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.875+0000 7fa1445cb700 1 Processor -- start 2022-03-21T13:54:36.915 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.875+0000 7fa1445cb700 1 -- start start 2022-03-21T13:54:36.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7f029ef58700 1 -- 172.21.15.160:0/3328162716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02981526c0 msgr2=0x7f02980c2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7f029ef58700 1 --2- 172.21.15.160:0/3328162716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02981526c0 0x7f02980c2600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f02980bbb10 tx=0x7f0290009780 comp rx=0 tx=0).stop 2022-03-21T13:54:36.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7f267241e700 1 Processor -- start 2022-03-21T13:54:36.917 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fee64ff9700 1 -- 172.21.15.160:0/3307012834 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fee5c017080 con 0x7fee680c3040 2022-03-21T13:54:36.918 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7f029ef58700 1 -- 172.21.15.160:0/3328162716 shutdown_connections 2022-03-21T13:54:36.918 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7f029ef58700 1 --2- 172.21.15.160:0/3328162716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02981526c0 0x7f02980c2600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.918 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7f029ef58700 1 --2- 172.21.15.160:0/3328162716 >> v2:172.21.15.171:3300/0 conn(0x7f02980bef40 0x7f029806c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.918 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7f029ef58700 1 -- 172.21.15.160:0/3328162716 >> 172.21.15.160:0/3328162716 conn(0x7f02980c7d30 msgr2=0x7f02980c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:36.919 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7f029ef58700 1 -- 172.21.15.160:0/3328162716 shutdown_connections 2022-03-21T13:54:36.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fa1445cb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13c06b190 0x7fa13c140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fa1445cb700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.921 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fa1445cb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa13c0ba6d0 0x7fa13c0c2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.921 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fa1445cb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0bb900 con 0x7fa13c06b190 2022-03-21T13:54:36.921 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fa1445cb700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0baaa0 con 0x7fa13c0ba6d0 2022-03-21T13:54:36.921 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fa1445cb700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0c5970 con 0x7fa13c06ca80 2022-03-21T13:54:36.922 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fa141b66700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.922 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fa142b68700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa13c0ba6d0 0x7fa13c0c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.922 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fa142b68700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa13c0ba6d0 0x7fa13c0c2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59678/0 (socket says 172.21.15.160:59678) 2022-03-21T13:54:36.922 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fa141b66700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47134/0 (socket says 172.21.15.160:47134) 2022-03-21T13:54:36.923 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7fa142b68700 1 -- 172.21.15.160:0/2242411663 learned_addr learned my addr 172.21.15.160:0/2242411663 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.923 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.877+0000 7fa141b66700 1 -- 172.21.15.160:0/2242411663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa13c0ba6d0 msgr2=0x7fa13c0c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.923 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.877+0000 7fa141b66700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa13c0ba6d0 0x7fa13c0c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.923 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.877+0000 7fa141b66700 1 -- 172.21.15.160:0/2242411663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13c06b190 msgr2=0x7fa13c140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.923 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.877+0000 7fa141b66700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13c06b190 0x7fa13c140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.877+0000 7fa141b66700 1 -- 172.21.15.160:0/2242411663 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c011c10 con 0x7fa13c06ca80 2022-03-21T13:54:36.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.877+0000 7fa141b66700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c1e30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa12c01d000 tx=0x7fa12c020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.877+0000 7fa12a7fc700 1 -- 172.21.15.160:0/2242411663 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0043a0 con 0x7fa13c06ca80 2022-03-21T13:54:36.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.877+0000 7fa12a7fc700 1 -- 172.21.15.160:0/2242411663 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c004520 con 0x7fa13c06ca80 2022-03-21T13:54:36.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.877+0000 7fa1445cb700 1 -- 172.21.15.160:0/2242411663 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13c0bacf0 con 0x7fa13c06ca80 2022-03-21T13:54:36.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.877+0000 7fa1445cb700 1 -- 172.21.15.160:0/2242411663 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13c0bb2b0 con 0x7fa13c06ca80 2022-03-21T13:54:36.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.876+0000 7f029ef58700 1 -- 172.21.15.160:0/3328162716 wait complete. 2022-03-21T13:54:36.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.878+0000 7f029ef58700 1 Processor -- start 2022-03-21T13:54:36.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.878+0000 7fa1445cb700 1 -- 172.21.15.160:0/2242411663 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13c070ae0 con 0x7fa13c06ca80 2022-03-21T13:54:36.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f267241e700 1 -- start start 2022-03-21T13:54:36.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.878+0000 7f029ef58700 1 -- start start 2022-03-21T13:54:36.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f029ef58700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02980bef40 0x7f029816a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f029ef58700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02981522f0 0x7f02980b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f029ef58700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02981526c0 0x7f0298163380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f029ef58700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02980beac0 con 0x7f02981526c0 2022-03-21T13:54:36.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f029ef58700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029816a570 con 0x7f02981522f0 2022-03-21T13:54:36.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f029ef58700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02980bd0c0 con 0x7f02980bef40 2022-03-21T13:54:36.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f267241e700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f266c0ba5f0 0x7f266c0c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f267241e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c06a2d0 con 0x7f266c0c08d0 2022-03-21T13:54:36.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f267241e700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c06a5b0 con 0x7f266c0c0500 2022-03-21T13:54:36.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f267241e700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266c06c070 con 0x7f266c0ba5f0 2022-03-21T13:54:36.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.879+0000 7f0297fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02981522f0 0x7f02980b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f0297fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02981522f0 0x7f02980b90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59682/0 (socket says 172.21.15.160:59682) 2022-03-21T13:54:36.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f0297fff700 1 -- 172.21.15.160:0/3784300754 learned_addr learned my addr 172.21.15.160:0/3784300754 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f266b7fe700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f266c0ba5f0 0x7f266c0c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f266b7fe700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f266c0ba5f0 0x7f266c0c14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59686/0 (socket says 172.21.15.160:59686) 2022-03-21T13:54:36.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f266b7fe700 1 -- 172.21.15.160:0/1529823531 learned_addr learned my addr 172.21.15.160:0/1529823531 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f266b7fe700 1 -- 172.21.15.160:0/1529823531 >> v1:172.21.15.171:6789/0 conn(0x7f266c0c0500 legacy=0x7f266c0c2930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-03-21T13:54:36.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f266b7fe700 1 -- 172.21.15.160:0/1529823531 >> v1:172.21.15.160:6789/0 conn(0x7f266c0c08d0 legacy=0x7f266c06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f266b7fe700 1 -- 172.21.15.160:0/1529823531 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c06a890 con 0x7f266c0ba5f0 2022-03-21T13:54:36.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f029d4f5700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02981526c0 0x7f0298163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f029ccf4700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02980bef40 0x7f029816a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f0297fff700 1 -- 172.21.15.160:0/3784300754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02980bef40 msgr2=0x7f029816a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f0297fff700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02980bef40 0x7f029816a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f0297fff700 1 -- 172.21.15.160:0/3784300754 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02981526c0 msgr2=0x7f0298163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f0297fff700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02981526c0 0x7f0298163380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f0297fff700 1 -- 172.21.15.160:0/3784300754 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0290009a20 con 0x7f02981522f0 2022-03-21T13:54:36.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f029ccf4700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02980bef40 0x7f029816a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:54:36.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f4a1f7fe700 1 -- 172.21.15.160:0/1289601147 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f4a28134e90 con 0x7f4a28068f90 2022-03-21T13:54:36.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7f0297fff700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02981522f0 0x7f02980b90b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f028800b490 tx=0x7f0288009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7f4a1e59c700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4a0c063ce0 0x7f4a0c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.880+0000 7f266b7fe700 1 --2- 172.21.15.160:0/1529823531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f266c0ba5f0 0x7f266c0c14c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f265c006fd0 tx=0x7f265c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28493f8920b3391 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7f266affd700 1 -- 172.21.15.160:0/1529823531 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c011630 con 0x7f266c0ba5f0 2022-03-21T13:54:36.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7f266affd700 1 -- 172.21.15.160:0/1529823531 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c011790 con 0x7f266c0ba5f0 2022-03-21T13:54:36.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7f266affd700 1 -- 172.21.15.160:0/1529823531 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c011b50 con 0x7f266c0ba5f0 2022-03-21T13:54:36.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7f0294ff9700 1 -- 172.21.15.160:0/3784300754 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288011630 con 0x7f02981522f0 2022-03-21T13:54:36.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7f029ef58700 1 -- 172.21.15.160:0/3784300754 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02980bd3a0 con 0x7f02981522f0 2022-03-21T13:54:36.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7f0294ff9700 1 -- 172.21.15.160:0/3784300754 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02880117b0 con 0x7f02981522f0 2022-03-21T13:54:36.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7f0294ff9700 1 -- 172.21.15.160:0/3784300754 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288011b70 con 0x7f02981522f0 2022-03-21T13:54:36.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7fa12a7fc700 1 -- 172.21.15.160:0/2242411663 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c00faa0 con 0x7fa13c06ca80 2022-03-21T13:54:36.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7f5318219700 1 Processor -- start 2022-03-21T13:54:36.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.882+0000 7f267241e700 1 -- 172.21.15.160:0/1529823531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f266c0ba5f0 msgr2=0x7f266c0c14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.882+0000 7f267241e700 1 --2- 172.21.15.160:0/1529823531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f266c0ba5f0 0x7f266c0c14c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f265c006fd0 tx=0x7f265c0090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.882+0000 7f5318219700 1 -- start start 2022-03-21T13:54:36.942 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.881+0000 7f029ef58700 1 -- 172.21.15.160:0/3784300754 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02980bd960 con 0x7f02981522f0 2022-03-21T13:54:36.942 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.882+0000 7f267241e700 1 -- 172.21.15.160:0/1529823531 shutdown_connections 2022-03-21T13:54:36.943 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.882+0000 7f267241e700 1 --2- 172.21.15.160:0/1529823531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f266c0ba5f0 0x7f266c0c14c0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f265c006fd0 tx=0x7f265c0090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.943 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.882+0000 7f267241e700 1 -- 172.21.15.160:0/1529823531 >> 172.21.15.160:0/1529823531 conn(0x7f266c068620 msgr2=0x7f266c0c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:36.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.882+0000 7f5318219700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5310067470 0x7f5310154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f5318219700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c3a70 0x7f531006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f5318219700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f531006e050 0x7f53101520b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f5318219700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531006e930 con 0x7f5310067470 2022-03-21T13:54:36.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f5318219700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531006d0c0 con 0x7f531006e050 2022-03-21T13:54:36.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f5318219700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531006d680 con 0x7f53100c3a70 2022-03-21T13:54:36.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f53167b6700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f531006e050 0x7f53101520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f53167b6700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f531006e050 0x7f53101520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.160:59692/0 (socket says 172.21.15.160:59692) 2022-03-21T13:54:36.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f53167b6700 1 -- 172.21.15.160:0/2656115655 learned_addr learned my addr 172.21.15.160:0/2656115655 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f5315fb5700 1 --2- 172.21.15.160:0/2656115655 >> v2:172.21.15.160:3300/0 conn(0x7f5310067470 0x7f5310154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f53157b4700 1 --2- 172.21.15.160:0/2656115655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c3a70 0x7f531006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.947 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f0294ff9700 1 -- 172.21.15.160:0/3784300754 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f028800f050 con 0x7f02981522f0 2022-03-21T13:54:36.947 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f267241e700 1 -- 172.21.15.160:0/1529823531 shutdown_connections 2022-03-21T13:54:36.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f5315fb5700 1 -- 172.21.15.160:0/2656115655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c3a70 msgr2=0x7f531006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:36.948 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f5315fb5700 1 --2- 172.21.15.160:0/2656115655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c3a70 0x7f531006db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f5315fb5700 1 -- 172.21.15.160:0/2656115655 >> v2:172.21.15.171:3300/0 conn(0x7f531006e050 msgr2=0x7f53101520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:36.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f5315fb5700 1 --2- 172.21.15.160:0/2656115655 >> v2:172.21.15.171:3300/0 conn(0x7f531006e050 0x7f53101520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.949 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f5315fb5700 1 -- 172.21.15.160:0/2656115655 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5310155300 con 0x7f5310067470 2022-03-21T13:54:36.950 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f53167b6700 1 --2- 172.21.15.160:0/2656115655 >> v2:172.21.15.171:3300/0 conn(0x7f531006e050 0x7f53101520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:36.950 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f267241e700 1 -- 172.21.15.160:0/1529823531 wait complete. 2022-03-21T13:54:36.951 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.884+0000 7f0294ff9700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0278063e30 0x7f02780662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.951 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.884+0000 7f0294ff9700 1 -- 172.21.15.160:0/3784300754 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f02880804f0 con 0x7f02981522f0 2022-03-21T13:54:36.951 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.883+0000 7f4a1e59c700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4a0c063ce0 0x7f4a0c066190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4a10006fd0 tx=0x7f4a10016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.952 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.885+0000 7f029ccf4700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0278063e30 0x7f02780662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.952 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.885+0000 7f267241e700 1 Processor -- start 2022-03-21T13:54:36.953 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.885+0000 7f5315fb5700 1 --2- 172.21.15.160:0/2656115655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5310067470 0x7f5310154dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f53100c5be0 tx=0x7f530c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca7f1b959408a6a server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.954 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.886+0000 7f029ef58700 1 -- 172.21.15.160:0/3784300754 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02980c7b70 con 0x7f02981522f0 2022-03-21T13:54:36.954 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.886+0000 7f029ccf4700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0278063e30 0x7f02780662e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f028c0016b0 tx=0x7f028c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.954 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.886+0000 7f267241e700 1 -- start start 2022-03-21T13:54:36.955 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f5314fb3700 1 -- 172.21.15.160:0/2656115655 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0105b0 con 0x7f5310067470 2022-03-21T13:54:36.956 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f267241e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f266c0c0500 0x7f266c14b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.956 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f267241e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f266c0c08d0 0x7f266c149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.957 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f267241e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f266c150da0 0x7f266c14a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.957 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f267241e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c13faf0 con 0x7f266c0c08d0 2022-03-21T13:54:36.957 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f267241e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c148610 con 0x7f266c150da0 2022-03-21T13:54:36.957 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f267241e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c14b350 con 0x7f266c0c0500 2022-03-21T13:54:36.958 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f266b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f266c0c08d0 0x7f266c149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.958 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f266b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f266c0c08d0 0x7f266c149fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56762/0 (socket says 172.21.15.160:56762) 2022-03-21T13:54:36.958 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f266b7fe700 1 -- 172.21.15.160:0/1666409598 learned_addr learned my addr 172.21.15.160:0/1666409598 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.958 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f5314fb3700 1 -- 172.21.15.160:0/2656115655 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c010710 con 0x7f5310067470 2022-03-21T13:54:36.959 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f5314fb3700 1 -- 172.21.15.160:0/2656115655 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c010ad0 con 0x7f5310067470 2022-03-21T13:54:36.959 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f5318219700 1 -- 172.21.15.160:0/2656115655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5310067470 msgr2=0x7f5310154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.959 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f5318219700 1 --2- 172.21.15.160:0/2656115655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5310067470 0x7f5310154dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f53100c5be0 tx=0x7f530c009060 comp rx=0 tx=0).stop 2022-03-21T13:54:36.959 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f5318219700 1 -- 172.21.15.160:0/2656115655 shutdown_connections 2022-03-21T13:54:36.960 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f5318219700 1 --2- 172.21.15.160:0/2656115655 >> v2:172.21.15.171:3300/0 conn(0x7f531006e050 0x7f53101520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.960 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f5318219700 1 --2- 172.21.15.160:0/2656115655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5310067470 0x7f5310154dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.960 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f5318219700 1 --2- 172.21.15.160:0/2656115655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c3a70 0x7f531006db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.960 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.887+0000 7f5318219700 1 -- 172.21.15.160:0/2656115655 >> 172.21.15.160:0/2656115655 conn(0x7f53100c87e0 msgr2=0x7f53100c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:36.961 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f266b7fe700 1 -- 172.21.15.160:0/1666409598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f266c0c0500 msgr2=0x7f266c14b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.961 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f266b7fe700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f266c0c0500 0x7f266c14b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.962 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f266b7fe700 1 -- 172.21.15.160:0/1666409598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f266c150da0 msgr2=0x7f266c14a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.962 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f26709bb700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f266c150da0 0x7f266c14a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.962 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f266b7fe700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f266c150da0 0x7f266c14a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.962 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f266b7fe700 1 -- 172.21.15.160:0/1666409598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c009370 con 0x7f266c0c08d0 2022-03-21T13:54:36.963 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f5318219700 1 -- 172.21.15.160:0/2656115655 shutdown_connections 2022-03-21T13:54:36.963 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f5318219700 1 -- 172.21.15.160:0/2656115655 wait complete. 2022-03-21T13:54:36.964 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f266b7fe700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f266c0c08d0 0x7f266c149fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f265c009340 tx=0x7f265c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.964 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f2653fff700 1 -- 172.21.15.160:0/1666409598 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c01f070 con 0x7f266c0c08d0 2022-03-21T13:54:36.964 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f267241e700 1 -- 172.21.15.160:0/1666409598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c149d00 con 0x7f266c0c08d0 2022-03-21T13:54:36.965 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f2653fff700 1 -- 172.21.15.160:0/1666409598 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c000bc0 con 0x7f266c0c08d0 2022-03-21T13:54:36.965 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f2653fff700 1 -- 172.21.15.160:0/1666409598 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c011b30 con 0x7f266c0c08d0 2022-03-21T13:54:36.965 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.888+0000 7f267241e700 1 -- 172.21.15.160:0/1666409598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c149740 con 0x7f266c0c08d0 2022-03-21T13:54:36.966 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.889+0000 7f5318219700 1 Processor -- start 2022-03-21T13:54:36.967 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.889+0000 7f5318219700 1 -- start start 2022-03-21T13:54:36.967 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.890+0000 7f5318219700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5310067470 0x7f5310168420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.967 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.890+0000 7f5318219700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f531006e050 0x7f5310168960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.890+0000 7f5318219700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53100c3a70 0x7f531014fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.890+0000 7f5318219700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53100acb70 con 0x7f531006e050 2022-03-21T13:54:36.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.890+0000 7f5318219700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53100ad670 con 0x7f53100c3a70 2022-03-21T13:54:36.968 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.890+0000 7f5318219700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531014f640 con 0x7f5310067470 2022-03-21T13:54:36.969 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.890+0000 7f5315fb5700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5310067470 0x7f5310168420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.969 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.890+0000 7f5315fb5700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5310067470 0x7f5310168420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47162/0 (socket says 172.21.15.160:47162) 2022-03-21T13:54:36.969 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.890+0000 7f5315fb5700 1 -- 172.21.15.160:0/2708246250 learned_addr learned my addr 172.21.15.160:0/2708246250 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.970 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f0294ff9700 1 -- 172.21.15.160:0/3784300754 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f028804f000 con 0x7f02981522f0 2022-03-21T13:54:36.970 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f53167b6700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53100c3a70 0x7f531014fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.971 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f5315fb5700 1 -- 172.21.15.160:0/2708246250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53100c3a70 msgr2=0x7f531014fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.971 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f5315fb5700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53100c3a70 0x7f531014fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.971 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f5315fb5700 1 -- 172.21.15.160:0/2708246250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f531006e050 msgr2=0x7f5310168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.971 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f5315fb5700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f531006e050 0x7f5310168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.972 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f5315fb5700 1 -- 172.21.15.160:0/2708246250 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5308009ae0 con 0x7f5310067470 2022-03-21T13:54:36.972 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f5315fb5700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5310067470 0x7f5310168420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f530c010630 tx=0x7f530c016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.972 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f2653fff700 1 -- 172.21.15.160:0/1666409598 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f265c00f050 con 0x7f266c0c08d0 2022-03-21T13:54:36.973 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f52fdffb700 1 -- 172.21.15.160:0/2708246250 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c010a90 con 0x7f5310067470 2022-03-21T13:54:36.973 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f52fdffb700 1 -- 172.21.15.160:0/2708246250 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c000c90 con 0x7f5310067470 2022-03-21T13:54:36.973 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.891+0000 7f52fdffb700 1 -- 172.21.15.160:0/2708246250 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0042a0 con 0x7f5310067470 2022-03-21T13:54:36.974 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.884+0000 7fa12a7fc700 1 -- 172.21.15.160:0/2242411663 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fa12c0034e0 con 0x7fa13c06ca80 2022-03-21T13:54:36.974 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.884+0000 7fa12a7fc700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa11c063cb0 0x7fa11c066160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.974 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.884+0000 7fa12a7fc700 1 -- 172.21.15.160:0/2242411663 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa12c08a910 con 0x7fa13c06ca80 2022-03-21T13:54:36.975 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.886+0000 7fa12a7fc700 1 -- 172.21.15.160:0/2242411663 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fa12c059490 con 0x7fa13c06ca80 2022-03-21T13:54:36.975 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.892+0000 7f2653fff700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f264c063ce0 0x7f264c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.975 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.892+0000 7f2653fff700 1 -- 172.21.15.160:0/1666409598 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f265c081a20 con 0x7f266c0c08d0 2022-03-21T13:54:36.976 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.892+0000 7f267241e700 1 -- 172.21.15.160:0/1666409598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c070ae0 con 0x7f266c0c08d0 2022-03-21T13:54:36.976 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.897+0000 7f26709bb700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f266c150da0 0x7f266c14a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:54:36.976 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.897+0000 7f266bfff700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f264c063ce0 0x7f264c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.977 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.892+0000 7fa142367700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa11c063cb0 0x7fa11c066160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.977 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.900+0000 7fa142367700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa11c063cb0 0x7fa11c066160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa138009660 tx=0x7fa138006b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.977 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.909+0000 7f7d2359e700 1 Processor -- start 2022-03-21T13:54:36.978 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.909+0000 7f7d2359e700 1 -- start start 2022-03-21T13:54:36.978 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.910+0000 7f7d2359e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d24159890 0x7f7d24158f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.978 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.910+0000 7f7d2359e700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7d2406d900 0x7f7d2406dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.978 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.910+0000 7f7d2359e700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d241569c0 con 0x7f7d24159c60 2022-03-21T13:54:36.978 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.910+0000 7f7d2359e700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2406e2a0 con 0x7f7d2406d900 2022-03-21T13:54:36.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.910+0000 7f7d2359e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2406c420 con 0x7f7d24159890 2022-03-21T13:54:36.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.911+0000 7f7d2259c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d24159890 0x7f7d24158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.911+0000 7f7d2259c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d24159890 0x7f7d24158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47174/0 (socket says 172.21.15.160:47174) 2022-03-21T13:54:36.979 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.911+0000 7f7d2259c700 1 -- 172.21.15.160:0/2930537271 learned_addr learned my addr 172.21.15.160:0/2930537271 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.911+0000 7f7d22d9d700 1 --2- 172.21.15.160:0/2930537271 >> v2:172.21.15.171:3300/0 conn(0x7f7d2406d900 0x7f7d2406dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.911+0000 7f7d2259c700 1 -- 172.21.15.160:0/2930537271 >> v2:172.21.15.171:3300/0 conn(0x7f7d2406d900 msgr2=0x7f7d2406dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:36.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.911+0000 7f7d2259c700 1 --2- 172.21.15.160:0/2930537271 >> v2:172.21.15.171:3300/0 conn(0x7f7d2406d900 0x7f7d2406dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.911+0000 7f7d2259c700 1 -- 172.21.15.160:0/2930537271 >> v1:172.21.15.171:6789/0 conn(0x7f7d24159c60 legacy=0x7f7d24066b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:36.980 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.911+0000 7f7d2259c700 1 -- 172.21.15.160:0/2930537271 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d240c1e10 con 0x7f7d24159890 2022-03-21T13:54:36.981 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.897+0000 7f266bfff700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f264c063ce0 0x7f264c066190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2660009640 tx=0x7f2660006b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.981 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.901+0000 7f2653fff700 1 -- 172.21.15.160:0/1666409598 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f265c02a080 con 0x7f266c0c08d0 2022-03-21T13:54:36.982 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.892+0000 7f5318219700 1 -- 172.21.15.160:0/2708246250 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530c0092a0 con 0x7f5310067470 2022-03-21T13:54:36.982 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.892+0000 7f5318219700 1 -- 172.21.15.160:0/2708246250 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53100abf50 con 0x7f5310067470 2022-03-21T13:54:36.982 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.902+0000 7f5318219700 1 -- 172.21.15.160:0/2708246250 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531014f920 con 0x7f5310067470 2022-03-21T13:54:36.982 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.905+0000 7f52fdffb700 1 -- 172.21.15.160:0/2708246250 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f530c00f070 con 0x7f5310067470 2022-03-21T13:54:36.983 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.905+0000 7f52fdffb700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f52f0063d60 0x7f52f0066210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.983 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.905+0000 7f52fdffb700 1 -- 172.21.15.160:0/2708246250 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f530c082690 con 0x7f5310067470 2022-03-21T13:54:36.983 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.908+0000 7f53157b4700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f52f0063d60 0x7f52f0066210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.983 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.908+0000 7f53157b4700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f52f0063d60 0x7f52f0066210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53100adb80 tx=0x7f5300009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.983 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.911+0000 7f52fdffb700 1 -- 172.21.15.160:0/2708246250 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f530c051200 con 0x7f5310067470 2022-03-21T13:54:36.985 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.921+0000 7f7d2259c700 1 --2- 172.21.15.160:0/2930537271 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d24159890 0x7f7d24158f50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c006fd0 tx=0x7f7d0c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f99c082c7f4cf489 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.985 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.921+0000 7f7d2159a700 1 -- 172.21.15.160:0/2930537271 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011630 con 0x7f7d24159890 2022-03-21T13:54:36.985 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.921+0000 7f7d2159a700 1 -- 172.21.15.160:0/2930537271 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0117b0 con 0x7f7d24159890 2022-03-21T13:54:36.985 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.921+0000 7f7d2159a700 1 -- 172.21.15.160:0/2930537271 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011b70 con 0x7f7d24159890 2022-03-21T13:54:36.986 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.922+0000 7f7d2359e700 1 -- 172.21.15.160:0/2930537271 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d24159890 msgr2=0x7f7d24158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.986 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.922+0000 7f7d2359e700 1 --2- 172.21.15.160:0/2930537271 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d24159890 0x7f7d24158f50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c006fd0 tx=0x7f7d0c0090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.986 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.932+0000 7f7d2359e700 1 -- 172.21.15.160:0/2930537271 shutdown_connections 2022-03-21T13:54:36.987 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.932+0000 7f7d2359e700 1 --2- 172.21.15.160:0/2930537271 >> v2:172.21.15.171:3300/0 conn(0x7f7d2406d900 0x7f7d2406dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.987 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.932+0000 7f7d2359e700 1 --2- 172.21.15.160:0/2930537271 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d24159890 0x7f7d24158f50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.987 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.932+0000 7f7d2359e700 1 -- 172.21.15.160:0/2930537271 >> 172.21.15.160:0/2930537271 conn(0x7f7d240c45d0 msgr2=0x7f7d240c49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:36.988 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.932+0000 7f7d2359e700 1 -- 172.21.15.160:0/2930537271 shutdown_connections 2022-03-21T13:54:36.988 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.932+0000 7f7d2359e700 1 -- 172.21.15.160:0/2930537271 wait complete. 2022-03-21T13:54:36.988 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.934+0000 7f7d2359e700 1 Processor -- start 2022-03-21T13:54:36.988 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.934+0000 7f7d2359e700 1 -- start start 2022-03-21T13:54:36.989 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.935+0000 7f7d2359e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d2406d900 0x7f7d2413c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.989 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.935+0000 7f7d2359e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d24159890 0x7f7d241488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.989 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.935+0000 7f7d2359e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d240bd550 0x7f7d2415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.989 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.935+0000 7f7d2359e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2413cd60 con 0x7f7d2406d900 2022-03-21T13:54:36.990 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.935+0000 7f7d2359e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d24148e00 con 0x7f7d24159890 2022-03-21T13:54:36.990 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.935+0000 7f7d2359e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240becd0 con 0x7f7d240bd550 2022-03-21T13:54:36.990 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.936+0000 7f7d21d9b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d24159890 0x7f7d241488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.990 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.936+0000 7f7d22d9d700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d240bd550 0x7f7d2415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.991 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.936+0000 7f7d22d9d700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d240bd550 0x7f7d2415e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47182/0 (socket says 172.21.15.160:47182) 2022-03-21T13:54:36.991 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.936+0000 7f7d22d9d700 1 -- 172.21.15.160:0/3273685433 learned_addr learned my addr 172.21.15.160:0/3273685433 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:36.991 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.937+0000 7f7d21d9b700 1 -- 172.21.15.160:0/3273685433 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d240bd550 msgr2=0x7f7d2415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.991 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.937+0000 7f7d21d9b700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d240bd550 0x7f7d2415e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.991 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.937+0000 7f7d21d9b700 1 -- 172.21.15.160:0/3273685433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d2406d900 msgr2=0x7f7d2413c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:36.992 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.937+0000 7f7d21d9b700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d2406d900 0x7f7d2413c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:36.992 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.937+0000 7f7d21d9b700 1 -- 172.21.15.160:0/3273685433 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c009370 con 0x7f7d24159890 2022-03-21T13:54:36.992 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.940+0000 7f7d21d9b700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d24159890 0x7f7d241488c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c4c0 tx=0x7f7d14007d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.992 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.940+0000 7f7d1a7fc700 1 -- 172.21.15.160:0/3273685433 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400ce20 con 0x7f7d24159890 2022-03-21T13:54:36.992 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.940+0000 7f7d1a7fc700 1 -- 172.21.15.160:0/3273685433 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d140052e0 con 0x7f7d24159890 2022-03-21T13:54:36.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.940+0000 7f7d1a7fc700 1 -- 172.21.15.160:0/3273685433 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14003710 con 0x7f7d24159890 2022-03-21T13:54:36.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.940+0000 7f7d2359e700 1 -- 172.21.15.160:0/3273685433 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d240c60f0 con 0x7f7d24159890 2022-03-21T13:54:36.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.940+0000 7f7d2359e700 1 -- 172.21.15.160:0/3273685433 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2415f0d0 con 0x7f7d24159890 2022-03-21T13:54:36.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.942+0000 7f7d2359e700 1 -- 172.21.15.160:0/3273685433 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc005130 con 0x7f7d24159890 2022-03-21T13:54:36.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.944+0000 7f7d1a7fc700 1 -- 172.21.15.160:0/3273685433 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f7d14019030 con 0x7f7d24159890 2022-03-21T13:54:36.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.944+0000 7f7d1a7fc700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7d04063fa0 0x7f7d04066450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:36.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.944+0000 7f7d1a7fc700 1 -- 172.21.15.160:0/3273685433 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d1407f9a0 con 0x7f7d24159890 2022-03-21T13:54:36.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.945+0000 7f7d2259c700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7d04063fa0 0x7f7d04066450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:36.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.946+0000 7f7d2259c700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7d04063fa0 0x7f7d04066450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c006fd0 tx=0x7f7d0c014000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:36.995 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:36.948+0000 7f7d1a7fc700 1 -- 172.21.15.160:0/3273685433 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f7d14048ae0 con 0x7f7d24159890 2022-03-21T13:54:37.195 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.193+0000 7fc32359e700 1 -- 172.21.15.160:0/1115797404 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc3040053e0 con 0x7fc324067960 2022-03-21T13:54:37.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.194+0000 7fc31a7fc700 1 -- 172.21.15.160:0/1115797404 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc31404f2a0 con 0x7fc324067960 2022-03-21T13:54:37.197 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:37.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.197+0000 7fc32359e700 1 -- 172.21.15.160:0/1115797404 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fc30c063fa0 msgr2=0x7fc30c066450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.197+0000 7fc32359e700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fc30c063fa0 0x7fc30c066450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc32406d7e0 tx=0x7fc310009040 comp rx=0 tx=0).stop 2022-03-21T13:54:37.200 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.197+0000 7fc32359e700 1 -- 172.21.15.160:0/1115797404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324067960 msgr2=0x7fc324143550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.200 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.197+0000 7fc32359e700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324067960 0x7fc324143550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc31400b4c0 tx=0x7fc314009060 comp rx=0 tx=0).stop 2022-03-21T13:54:37.200 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.197+0000 7fc32359e700 1 -- 172.21.15.160:0/1115797404 shutdown_connections 2022-03-21T13:54:37.200 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.197+0000 7fc32359e700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fc30c063fa0 0x7fc30c066450 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc32406d7e0 tx=0x7fc310009040 comp rx=0 tx=0).stop 2022-03-21T13:54:37.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.197+0000 7fc32359e700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc32406b2d0 0x7fc324144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.197+0000 7fc32359e700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324067960 0x7fc324143550 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.197+0000 7fc32359e700 1 --2- 172.21.15.160:0/1115797404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc324067d30 0x7fc324144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.201 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.197+0000 7fc32359e700 1 -- 172.21.15.160:0/1115797404 >> 172.21.15.160:0/1115797404 conn(0x7fc3240c6a50 msgr2=0x7fc3240c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:37.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.198+0000 7fc32359e700 1 -- 172.21.15.160:0/1115797404 shutdown_connections 2022-03-21T13:54:37.202 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.199+0000 7fc32359e700 1 -- 172.21.15.160:0/1115797404 wait complete. 2022-03-21T13:54:37.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2022-03-21T13:54:37.218 DEBUG:teuthology.parallel:result is None 2022-03-21T13:54:37.234 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.233+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1289601147 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4a28134e90 con 0x7f4a28068f90 2022-03-21T13:54:37.235 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.234+0000 7f4a1f7fe700 1 -- 172.21.15.160:0/1289601147 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a18058020 con 0x7f4a28068f90 2022-03-21T13:54:37.236 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:37.252 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.251+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1289601147 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4a0c063ce0 msgr2=0x7f4a0c066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.253 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.251+0000 7f4a2d0e2700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4a0c063ce0 0x7f4a0c066190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4a10006fd0 tx=0x7f4a10016000 comp rx=0 tx=0).stop 2022-03-21T13:54:37.253 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.251+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1289601147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a28068f90 msgr2=0x7f4a280b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.253 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.251+0000 7f4a2d0e2700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a28068f90 0x7f4a280b62a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800cfc0 tx=0x7f4a180078b0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.254 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.252+0000 7fee6db50700 1 -- 172.21.15.160:0/3307012834 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fee680681c0 con 0x7fee680c3040 2022-03-21T13:54:37.256 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.255+0000 7fee64ff9700 1 -- 172.21.15.160:0/3307012834 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee5c021020 con 0x7fee680c3040 2022-03-21T13:54:37.257 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.255+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1289601147 shutdown_connections 2022-03-21T13:54:37.257 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.255+0000 7f4a2d0e2700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4a0c063ce0 0x7f4a0c066190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.257 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.255+0000 7f4a2d0e2700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a28159cb0 0x7f4a28136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.258 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.255+0000 7f4a2d0e2700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a28068f90 0x7f4a280b62a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.258 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.255+0000 7f4a2d0e2700 1 --2- 172.21.15.160:0/1289601147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a281598e0 0x7f4a28136730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.258 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.255+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1289601147 >> 172.21.15.160:0/1289601147 conn(0x7f4a280c7f60 msgr2=0x7f4a280c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:37.259 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:37.259 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.258+0000 7fee6db50700 1 -- 172.21.15.160:0/3307012834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee48063d10 msgr2=0x7fee480661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.259 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.258+0000 7fee6db50700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee48063d10 0x7fee480661c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee58005750 tx=0x7fee58009040 comp rx=0 tx=0).stop 2022-03-21T13:54:37.260 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.258+0000 7fee6db50700 1 -- 172.21.15.160:0/3307012834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 msgr2=0x7fee68152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.260 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.258+0000 7fee6db50700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 0x7fee68152a40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00e960 tx=0x7fee5c009060 comp rx=0 tx=0).stop 2022-03-21T13:54:37.261 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.258+0000 7f029ef58700 1 -- 172.21.15.160:0/3784300754 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0298151c40 con 0x7f02981522f0 2022-03-21T13:54:37.261 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.259+0000 7fee6db50700 1 -- 172.21.15.160:0/3307012834 shutdown_connections 2022-03-21T13:54:37.262 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.259+0000 7fee6db50700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fee48063d10 0x7fee480661c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.262 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.259+0000 7fee6db50700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee68159740 0x7fee68151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.262 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.259+0000 7fee6db50700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee68068ca0 0x7fee680b8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.259+0000 7fee6db50700 1 --2- 172.21.15.160:0/3307012834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee680c3040 0x7fee68152a40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.259+0000 7fee6db50700 1 -- 172.21.15.160:0/3307012834 >> 172.21.15.160:0/3307012834 conn(0x7fee680c7dc0 msgr2=0x7fee68158930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:37.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.259+0000 7fee6db50700 1 -- 172.21.15.160:0/3307012834 shutdown_connections 2022-03-21T13:54:37.263 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.259+0000 7fee6db50700 1 -- 172.21.15.160:0/3307012834 wait complete. 2022-03-21T13:54:37.264 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.259+0000 7f0294ff9700 1 -- 172.21.15.160:0/3784300754 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0288015070 con 0x7f02981522f0 2022-03-21T13:54:37.264 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:37.265 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.261+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1289601147 shutdown_connections 2022-03-21T13:54:37.265 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.261+0000 7f5318219700 1 -- 172.21.15.160:0/2708246250 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5310155570 con 0x7f5310067470 2022-03-21T13:54:37.266 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.261+0000 7f4a2d0e2700 1 -- 172.21.15.160:0/1289601147 wait complete. 2022-03-21T13:54:37.266 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.262+0000 7f52fdffb700 1 -- 172.21.15.160:0/2708246250 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f530c02a090 con 0x7f5310067470 2022-03-21T13:54:37.267 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.264+0000 7f029ef58700 1 -- 172.21.15.160:0/3784300754 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0278063e30 msgr2=0x7f02780662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.267 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.264+0000 7f029ef58700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0278063e30 0x7f02780662e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f028c0016b0 tx=0x7f028c009040 comp rx=0 tx=0).stop 2022-03-21T13:54:37.267 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.264+0000 7f029ef58700 1 -- 172.21.15.160:0/3784300754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02981522f0 msgr2=0x7f02980b90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.267 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.264+0000 7f029ef58700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02981522f0 0x7f02980b90b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f028800b490 tx=0x7f0288009060 comp rx=0 tx=0).stop 2022-03-21T13:54:37.268 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.264+0000 7fa1445cb700 1 -- 172.21.15.160:0/2242411663 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa13c163a40 con 0x7fa13c06ca80 2022-03-21T13:54:37.268 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:37.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7f5318219700 1 -- 172.21.15.160:0/2708246250 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f52f0063d60 msgr2=0x7f52f0066210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7f5318219700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f52f0063d60 0x7f52f0066210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53100adb80 tx=0x7f5300009060 comp rx=0 tx=0).stop 2022-03-21T13:54:37.269 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7f5318219700 1 -- 172.21.15.160:0/2708246250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5310067470 msgr2=0x7f5310168420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7f5318219700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5310067470 0x7f5310168420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f530c010630 tx=0x7f530c016000 comp rx=0 tx=0).stop 2022-03-21T13:54:37.270 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7f267241e700 1 -- 172.21.15.160:0/1666409598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f266c0be600 con 0x7f266c0c08d0 2022-03-21T13:54:37.271 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7f5318219700 1 -- 172.21.15.160:0/2708246250 shutdown_connections 2022-03-21T13:54:37.271 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7f5318219700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f52f0063d60 0x7f52f0066210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.271 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7f5318219700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53100c3a70 0x7f531014fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.272 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7f5318219700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5310067470 0x7f5310168420 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.272 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7f5318219700 1 --2- 172.21.15.160:0/2708246250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f531006e050 0x7f5310168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.272 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7f5318219700 1 -- 172.21.15.160:0/2708246250 >> 172.21.15.160:0/2708246250 conn(0x7f53100c87e0 msgr2=0x7f53100c5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:37.272 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.265+0000 7fa12a7fc700 1 -- 172.21.15.160:0/2242411663 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa12c05cab0 con 0x7fa13c06ca80 2022-03-21T13:54:37.273 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.266+0000 7f2653fff700 1 -- 172.21.15.160:0/1666409598 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f265c015020 con 0x7f266c0c08d0 2022-03-21T13:54:37.273 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:37.274 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.267+0000 7f5318219700 1 -- 172.21.15.160:0/2708246250 shutdown_connections 2022-03-21T13:54:37.274 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.267+0000 7f5318219700 1 -- 172.21.15.160:0/2708246250 wait complete. 2022-03-21T13:54:37.275 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:37.275 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.269+0000 7f267241e700 1 -- 172.21.15.160:0/1666409598 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f264c063ce0 msgr2=0x7f264c066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.269+0000 7f267241e700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f264c063ce0 0x7f264c066190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2660009640 tx=0x7f2660006b60 comp rx=0 tx=0).stop 2022-03-21T13:54:37.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.269+0000 7f267241e700 1 -- 172.21.15.160:0/1666409598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f266c0c08d0 msgr2=0x7f266c149fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.269+0000 7f267241e700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f266c0c08d0 0x7f266c149fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f265c009340 tx=0x7f265c017000 comp rx=0 tx=0).stop 2022-03-21T13:54:37.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.269+0000 7f029ef58700 1 -- 172.21.15.160:0/3784300754 shutdown_connections 2022-03-21T13:54:37.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.269+0000 7f029ef58700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0278063e30 0x7f02780662e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.269+0000 7f029ef58700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02981526c0 0x7f0298163380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.269+0000 7f029ef58700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02980bef40 0x7f029816a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.269+0000 7f029ef58700 1 --2- 172.21.15.160:0/3784300754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02981522f0 0x7f02980b90b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.269+0000 7f029ef58700 1 -- 172.21.15.160:0/3784300754 >> 172.21.15.160:0/3784300754 conn(0x7f02980c7d30 msgr2=0x7f02980692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:37.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.271+0000 7f267241e700 1 -- 172.21.15.160:0/1666409598 shutdown_connections 2022-03-21T13:54:37.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.271+0000 7f267241e700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f264c063ce0 0x7f264c066190 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2660009640 tx=0x7f2660006b60 comp rx=0 tx=0).stop 2022-03-21T13:54:37.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.271+0000 7f267241e700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f266c150da0 0x7f266c14a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.279 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.271+0000 7f267241e700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f266c0c0500 0x7f266c14b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.280 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.271+0000 7f267241e700 1 --2- 172.21.15.160:0/1666409598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f266c0c08d0 0x7f266c149fb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.280 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.271+0000 7f267241e700 1 -- 172.21.15.160:0/1666409598 >> 172.21.15.160:0/1666409598 conn(0x7f266c068620 msgr2=0x7f266c0c4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:37.280 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.273+0000 7f029ef58700 1 -- 172.21.15.160:0/3784300754 shutdown_connections 2022-03-21T13:54:37.281 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.273+0000 7f029ef58700 1 -- 172.21.15.160:0/3784300754 wait complete. 2022-03-21T13:54:37.281 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.275+0000 7fa1445cb700 1 -- 172.21.15.160:0/2242411663 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa11c063cb0 msgr2=0x7fa11c066160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.275+0000 7fa1445cb700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa11c063cb0 0x7fa11c066160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa138009660 tx=0x7fa138006b90 comp rx=0 tx=0).stop 2022-03-21T13:54:37.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.275+0000 7fa1445cb700 1 -- 172.21.15.160:0/2242411663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 msgr2=0x7fa13c0c1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.275+0000 7fa1445cb700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c1e30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa12c01d000 tx=0x7fa12c020000 comp rx=0 tx=0).stop 2022-03-21T13:54:37.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.275+0000 7fa1445cb700 1 -- 172.21.15.160:0/2242411663 shutdown_connections 2022-03-21T13:54:37.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.275+0000 7fa1445cb700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fa11c063cb0 0x7fa11c066160 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.275+0000 7fa1445cb700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa13c0ba6d0 0x7fa13c0c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.275+0000 7fa1445cb700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13c06b190 0x7fa13c140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.275+0000 7fa1445cb700 1 --2- 172.21.15.160:0/2242411663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa13c06ca80 0x7fa13c0c1e30 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa12c01d000 tx=0x7fa12c020000 comp rx=0 tx=0).stop 2022-03-21T13:54:37.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.275+0000 7fa1445cb700 1 -- 172.21.15.160:0/2242411663 >> 172.21.15.160:0/2242411663 conn(0x7fa13c068620 msgr2=0x7fa13c0c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:37.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.276+0000 7f267241e700 1 -- 172.21.15.160:0/1666409598 shutdown_connections 2022-03-21T13:54:37.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.276+0000 7f267241e700 1 -- 172.21.15.160:0/1666409598 wait complete. 2022-03-21T13:54:37.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.276+0000 7fa1445cb700 1 -- 172.21.15.160:0/2242411663 shutdown_connections 2022-03-21T13:54:37.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.276+0000 7fa1445cb700 1 -- 172.21.15.160:0/2242411663 wait complete. 2022-03-21T13:54:37.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2022-03-21T13:54:37.286 DEBUG:teuthology.parallel:result is None 2022-03-21T13:54:37.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2022-03-21T13:54:37.290 DEBUG:teuthology.parallel:result is None 2022-03-21T13:54:37.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2022-03-21T13:54:37.293 DEBUG:teuthology.parallel:result is None 2022-03-21T13:54:37.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2022-03-21T13:54:37.295 DEBUG:teuthology.parallel:result is None 2022-03-21T13:54:37.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2022-03-21T13:54:37.296 DEBUG:teuthology.parallel:result is None 2022-03-21T13:54:37.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2022-03-21T13:54:37.298 DEBUG:teuthology.parallel:result is None 2022-03-21T13:54:37.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.305+0000 7f7d2359e700 1 -- 172.21.15.160:0/3273685433 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7cfc0053e0 con 0x7f7d24159890 2022-03-21T13:54:37.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.306+0000 7f7d1a7fc700 1 -- 172.21.15.160:0/3273685433 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d14017020 con 0x7f7d24159890 2022-03-21T13:54:37.308 INFO:teuthology.orchestra.run.smithi160.stdout:55834574853 2022-03-21T13:54:37.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 -- 172.21.15.160:0/3273685433 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7d04063fa0 msgr2=0x7f7d04066450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7d04063fa0 0x7f7d04066450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c006fd0 tx=0x7f7d0c014000 comp rx=0 tx=0).stop 2022-03-21T13:54:37.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 -- 172.21.15.160:0/3273685433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d24159890 msgr2=0x7f7d241488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d24159890 0x7f7d241488c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c4c0 tx=0x7f7d14007d00 comp rx=0 tx=0).stop 2022-03-21T13:54:37.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 -- 172.21.15.160:0/3273685433 shutdown_connections 2022-03-21T13:54:37.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f7d04063fa0 0x7f7d04066450 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d240bd550 0x7f7d2415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d2406d900 0x7f7d2413c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 --2- 172.21.15.160:0/3273685433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d24159890 0x7f7d241488c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 -- 172.21.15.160:0/3273685433 >> 172.21.15.160:0/3273685433 conn(0x7f7d240c45d0 msgr2=0x7f7d240c2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:37.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 -- 172.21.15.160:0/3273685433 shutdown_connections 2022-03-21T13:54:37.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.308+0000 7f7d2359e700 1 -- 172.21.15.160:0/3273685433 wait complete. 2022-03-21T13:54:37.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2022-03-21T13:54:37.321 DEBUG:teuthology.parallel:result is None 2022-03-21T13:54:37.322 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-03-21T13:54:37.322 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-03-21T13:54:37.475 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.473+0000 7f920159e700 1 Processor -- start 2022-03-21T13:54:37.475 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.473+0000 7f920159e700 1 -- start start 2022-03-21T13:54:37.478 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.474+0000 7f920159e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f91fc06cac0 0x7f91fc0c2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:37.478 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.474+0000 7f920159e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc06c070 con 0x7f91fc0b7d40 2022-03-21T13:54:37.478 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.474+0000 7f920159e700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc06e590 con 0x7f91fc0adb50 2022-03-21T13:54:37.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.474+0000 7f920159e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc06d140 con 0x7f91fc06cac0 2022-03-21T13:54:37.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.474+0000 7f91fbfff700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f91fc0b7d40 0x7f91fc153c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:59944/0 (socket says 172.21.15.160:59944) 2022-03-21T13:54:37.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.474+0000 7f91fb7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f91fc06cac0 0x7f91fc0c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:37.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.474+0000 7f91fbfff700 1 -- 172.21.15.160:0/1058772704 learned_addr learned my addr 172.21.15.160:0/1058772704 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:37.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f91fb7fe700 1 -- 172.21.15.160:0/1058772704 >> v1:172.21.15.171:6789/0 conn(0x7f91fc0adb50 legacy=0x7f91fc0c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:37.480 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f91fb7fe700 1 -- 172.21.15.160:0/1058772704 >> v1:172.21.15.160:6789/0 conn(0x7f91fc0b7d40 legacy=0x7f91fc153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.480 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f91fb7fe700 1 -- 172.21.15.160:0/1058772704 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc06e870 con 0x7f91fc06cac0 2022-03-21T13:54:37.480 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f91faffd700 1 -- 172.21.15.160:0/1058772704 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102461290 0 0) 0x7f91fc06c070 con 0x7f91fc0b7d40 2022-03-21T13:54:37.480 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f91fb7fe700 1 --2- 172.21.15.160:0/1058772704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc06cac0 0x7f91fc0c2790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009760 tx=0x7f91f0009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c214b170b27f68 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:37.481 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f91faffd700 1 -- 172.21.15.160:0/1058772704 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0004030 con 0x7f91fc06cac0 2022-03-21T13:54:37.481 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f91faffd700 1 -- 172.21.15.160:0/1058772704 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0004190 con 0x7f91fc06cac0 2022-03-21T13:54:37.481 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f91faffd700 1 -- 172.21.15.160:0/1058772704 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0011630 con 0x7f91fc06cac0 2022-03-21T13:54:37.481 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f920159e700 1 -- 172.21.15.160:0/1058772704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc06cac0 msgr2=0x7f91fc0c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.481 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f920159e700 1 --2- 172.21.15.160:0/1058772704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc06cac0 0x7f91fc0c2790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009760 tx=0x7f91f0009060 comp rx=0 tx=0).stop 2022-03-21T13:54:37.482 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f920159e700 1 -- 172.21.15.160:0/1058772704 shutdown_connections 2022-03-21T13:54:37.482 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f920159e700 1 --2- 172.21.15.160:0/1058772704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc06cac0 0x7f91fc0c2790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.482 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f920159e700 1 -- 172.21.15.160:0/1058772704 >> 172.21.15.160:0/1058772704 conn(0x7f91fc06aff0 msgr2=0x7f91fc06b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:37.482 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f920159e700 1 -- 172.21.15.160:0/1058772704 shutdown_connections 2022-03-21T13:54:37.483 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.475+0000 7f920159e700 1 -- 172.21.15.160:0/1058772704 wait complete. 2022-03-21T13:54:37.483 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.476+0000 7f920159e700 1 Processor -- start 2022-03-21T13:54:37.483 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.477+0000 7f920159e700 1 -- start start 2022-03-21T13:54:37.486 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.477+0000 7f920159e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc06cac0 0x7f91fc0bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:37.486 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.477+0000 7f920159e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc0adb50 0x7f91fc0b9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:37.486 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.477+0000 7f920159e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0b7d40 0x7f91fc155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:37.486 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.477+0000 7f920159e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0c8a70 con 0x7f91fc06cac0 2022-03-21T13:54:37.487 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.477+0000 7f920159e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0b8110 con 0x7f91fc0adb50 2022-03-21T13:54:37.487 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.477+0000 7f920159e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0bf850 con 0x7f91fc0b7d40 2022-03-21T13:54:37.487 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.477+0000 7f91fbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc06cac0 0x7f91fc0bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:37.487 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.477+0000 7f91fbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc06cac0 0x7f91fc0bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56798/0 (socket says 172.21.15.160:56798) 2022-03-21T13:54:37.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.477+0000 7f91fbfff700 1 -- 172.21.15.160:0/771375994 learned_addr learned my addr 172.21.15.160:0/771375994 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:37.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.478+0000 7f91fbfff700 1 -- 172.21.15.160:0/771375994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0b7d40 msgr2=0x7f91fc155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.478+0000 7f91fbfff700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0b7d40 0x7f91fc155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.478+0000 7f91fbfff700 1 -- 172.21.15.160:0/771375994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc0adb50 msgr2=0x7f91fc0b9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.478+0000 7f91fbfff700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc0adb50 0x7f91fc0b9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.478+0000 7f91fbfff700 1 -- 172.21.15.160:0/771375994 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00092a0 con 0x7f91fc06cac0 2022-03-21T13:54:37.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.478+0000 7f91fbfff700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc06cac0 0x7f91fc0bfce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c4e0 tx=0x7f91ec007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:37.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.478+0000 7f91e3fff700 1 -- 172.21.15.160:0/771375994 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec007360 con 0x7f91fc06cac0 2022-03-21T13:54:37.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.478+0000 7f91e3fff700 1 -- 172.21.15.160:0/771375994 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec0074c0 con 0x7f91fc06cac0 2022-03-21T13:54:37.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.478+0000 7f920159e700 1 -- 172.21.15.160:0/771375994 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc0bf520 con 0x7f91fc06cac0 2022-03-21T13:54:37.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.478+0000 7f91e3fff700 1 -- 172.21.15.160:0/771375994 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec004900 con 0x7f91fc06cac0 2022-03-21T13:54:37.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.478+0000 7f920159e700 1 -- 172.21.15.160:0/771375994 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc0c7e80 con 0x7f91fc06cac0 2022-03-21T13:54:37.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.479+0000 7f920159e700 1 -- 172.21.15.160:0/771375994 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc04b760 con 0x7f91fc06cac0 2022-03-21T13:54:37.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.479+0000 7f91e3fff700 1 -- 172.21.15.160:0/771375994 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f91ec010030 con 0x7f91fc06cac0 2022-03-21T13:54:37.491 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.480+0000 7f91e3fff700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f91dc063ce0 0x7f91dc066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:37.491 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.480+0000 7f91fb7fe700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f91dc063ce0 0x7f91dc066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:37.491 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.480+0000 7f91e3fff700 1 -- 172.21.15.160:0/771375994 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f91ec080540 con 0x7f91fc06cac0 2022-03-21T13:54:37.491 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.480+0000 7f91fb7fe700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f91dc063ce0 0x7f91dc066190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0bb380 tx=0x7f91f0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:37.492 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.484+0000 7f91e3fff700 1 -- 172.21.15.160:0/771375994 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f91ec04f1a0 con 0x7f91fc06cac0 2022-03-21T13:54:37.653 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.651+0000 7f920159e700 1 -- 172.21.15.160:0/771375994 --> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91fc0bf990 con 0x7f91dc063ce0 2022-03-21T13:54:37.661 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.659+0000 7f91e3fff700 1 -- 172.21.15.160:0/771375994 <== mgr.4104 v2:172.21.15.160:6832/25205 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284962 (secure 0 0 0) 0x7f91f0004300 con 0x7f91dc063ce0 2022-03-21T13:54:37.664 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:37.667 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 -- 172.21.15.160:0/771375994 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f91dc063ce0 msgr2=0x7f91dc066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.667 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f91dc063ce0 0x7f91dc066190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0bb380 tx=0x7f91f0016000 comp rx=0 tx=0).stop 2022-03-21T13:54:37.668 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 -- 172.21.15.160:0/771375994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc06cac0 msgr2=0x7f91fc0bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.668 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc06cac0 0x7f91fc0bfce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c4e0 tx=0x7f91ec007c70 comp rx=0 tx=0).stop 2022-03-21T13:54:37.668 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 -- 172.21.15.160:0/771375994 shutdown_connections 2022-03-21T13:54:37.668 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f91dc063ce0 0x7f91dc066190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.669 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0b7d40 0x7f91fc155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.669 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc06cac0 0x7f91fc0bfce0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.669 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 --2- 172.21.15.160:0/771375994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc0adb50 0x7f91fc0b9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.669 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 -- 172.21.15.160:0/771375994 >> 172.21.15.160:0/771375994 conn(0x7f91fc06aff0 msgr2=0x7f91fc0bb970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:37.669 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 -- 172.21.15.160:0/771375994 shutdown_connections 2022-03-21T13:54:37.670 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.662+0000 7f920159e700 1 -- 172.21.15.160:0/771375994 wait complete. 2022-03-21T13:54:37.670 INFO:teuthology.orchestra.run.smithi160.stderr:dumped all 2022-03-21T13:54:37.676 INFO:teuthology.orchestra.run.smithi160.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2022-03-21T13:54:37.460299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68600,"kb_used_data":1784,"kb_used_omap":0,"kb_used_meta":66752,"kb_avail":754906120,"statfs":{"total":773094113280,"available":773023866880,"internally_reserved":0,"allocated":1826816,"data_stored":1655956,"data_compressed":58760,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":68354048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.923330"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562599+0000","last_change":"2022-03-21T13:54:27.560800+0000","last_active":"2022-03-21T13:54:27.562599+0000","last_peered":"2022-03-21T13:54:27.562599+0000","last_clean":"2022-03-21T13:54:27.562599+0000","last_became_active":"2022-03-21T13:54:27.560524+0000","last_became_peered":"2022-03-21T13:54:27.560524+0000","last_unstale":"2022-03-21T13:54:27.562599+0000","last_undegraded":"2022-03-21T13:54:27.562599+0000","last_fullsized":"2022-03-21T13:54:27.562599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:29:18.469060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.550598+0000","last_change":"2022-03-21T13:54:27.546054+0000","last_active":"2022-03-21T13:54:27.550598+0000","last_peered":"2022-03-21T13:54:27.550598+0000","last_clean":"2022-03-21T13:54:27.550598+0000","last_became_active":"2022-03-21T13:54:27.545740+0000","last_became_peered":"2022-03-21T13:54:27.545740+0000","last_unstale":"2022-03-21T13:54:27.550598+0000","last_undegraded":"2022-03-21T13:54:27.550598+0000","last_fullsized":"2022-03-21T13:54:27.550598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:26:02.461346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561382+0000","last_change":"2022-03-21T13:54:27.558255+0000","last_active":"2022-03-21T13:54:27.561382+0000","last_peered":"2022-03-21T13:54:27.561382+0000","last_clean":"2022-03-21T13:54:27.561382+0000","last_became_active":"2022-03-21T13:54:27.558022+0000","last_became_peered":"2022-03-21T13:54:27.558022+0000","last_unstale":"2022-03-21T13:54:27.561382+0000","last_undegraded":"2022-03-21T13:54:27.561382+0000","last_fullsized":"2022-03-21T13:54:27.561382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:13:18.709698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566124+0000","last_change":"2022-03-21T13:54:27.557489+0000","last_active":"2022-03-21T13:54:27.566124+0000","last_peered":"2022-03-21T13:54:27.566124+0000","last_clean":"2022-03-21T13:54:27.566124+0000","last_became_active":"2022-03-21T13:54:27.557158+0000","last_became_peered":"2022-03-21T13:54:27.557158+0000","last_unstale":"2022-03-21T13:54:27.566124+0000","last_undegraded":"2022-03-21T13:54:27.566124+0000","last_fullsized":"2022-03-21T13:54:27.566124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:40:54.983646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.565666+0000","last_change":"2022-03-21T13:54:27.564403+0000","last_active":"2022-03-21T13:54:27.565666+0000","last_peered":"2022-03-21T13:54:27.565666+0000","last_clean":"2022-03-21T13:54:27.565666+0000","last_became_active":"2022-03-21T13:54:27.564206+0000","last_became_peered":"2022-03-21T13:54:27.564206+0000","last_unstale":"2022-03-21T13:54:27.565666+0000","last_undegraded":"2022-03-21T13:54:27.565666+0000","last_fullsized":"2022-03-21T13:54:27.565666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:59:14.326123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561303+0000","last_change":"2022-03-21T13:54:27.557180+0000","last_active":"2022-03-21T13:54:27.561303+0000","last_peered":"2022-03-21T13:54:27.561303+0000","last_clean":"2022-03-21T13:54:27.561303+0000","last_became_active":"2022-03-21T13:54:27.556920+0000","last_became_peered":"2022-03-21T13:54:27.556920+0000","last_unstale":"2022-03-21T13:54:27.561303+0000","last_undegraded":"2022-03-21T13:54:27.561303+0000","last_fullsized":"2022-03-21T13:54:27.561303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:08:18.086954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566644+0000","last_change":"2022-03-21T13:54:27.565259+0000","last_active":"2022-03-21T13:54:27.566644+0000","last_peered":"2022-03-21T13:54:27.566644+0000","last_clean":"2022-03-21T13:54:27.566644+0000","last_became_active":"2022-03-21T13:54:27.564920+0000","last_became_peered":"2022-03-21T13:54:27.564920+0000","last_unstale":"2022-03-21T13:54:27.566644+0000","last_undegraded":"2022-03-21T13:54:27.566644+0000","last_fullsized":"2022-03-21T13:54:27.566644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:32:42.928977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556183+0000","last_change":"2022-03-21T13:54:27.553677+0000","last_active":"2022-03-21T13:54:27.556183+0000","last_peered":"2022-03-21T13:54:27.556183+0000","last_clean":"2022-03-21T13:54:27.556183+0000","last_became_active":"2022-03-21T13:54:27.553385+0000","last_became_peered":"2022-03-21T13:54:27.553385+0000","last_unstale":"2022-03-21T13:54:27.556183+0000","last_undegraded":"2022-03-21T13:54:27.556183+0000","last_fullsized":"2022-03-21T13:54:27.556183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:11:07.645677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564122+0000","last_change":"2022-03-21T13:54:27.558348+0000","last_active":"2022-03-21T13:54:27.564122+0000","last_peered":"2022-03-21T13:54:27.564122+0000","last_clean":"2022-03-21T13:54:27.564122+0000","last_became_active":"2022-03-21T13:54:27.557809+0000","last_became_peered":"2022-03-21T13:54:27.557809+0000","last_unstale":"2022-03-21T13:54:27.564122+0000","last_undegraded":"2022-03-21T13:54:27.564122+0000","last_fullsized":"2022-03-21T13:54:27.564122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:46:38.130496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561257+0000","last_change":"2022-03-21T13:54:27.557849+0000","last_active":"2022-03-21T13:54:27.561257+0000","last_peered":"2022-03-21T13:54:27.561257+0000","last_clean":"2022-03-21T13:54:27.561257+0000","last_became_active":"2022-03-21T13:54:27.557598+0000","last_became_peered":"2022-03-21T13:54:27.557598+0000","last_unstale":"2022-03-21T13:54:27.561257+0000","last_undegraded":"2022-03-21T13:54:27.561257+0000","last_fullsized":"2022-03-21T13:54:27.561257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:02:12.450734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552732+0000","last_change":"2022-03-21T13:54:27.546503+0000","last_active":"2022-03-21T13:54:27.552732+0000","last_peered":"2022-03-21T13:54:27.552732+0000","last_clean":"2022-03-21T13:54:27.552732+0000","last_became_active":"2022-03-21T13:54:27.546206+0000","last_became_peered":"2022-03-21T13:54:27.546206+0000","last_unstale":"2022-03-21T13:54:27.552732+0000","last_undegraded":"2022-03-21T13:54:27.552732+0000","last_fullsized":"2022-03-21T13:54:27.552732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:30:57.355670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561846+0000","last_change":"2022-03-21T13:54:27.556507+0000","last_active":"2022-03-21T13:54:27.561846+0000","last_peered":"2022-03-21T13:54:27.561846+0000","last_clean":"2022-03-21T13:54:27.561846+0000","last_became_active":"2022-03-21T13:54:27.556230+0000","last_became_peered":"2022-03-21T13:54:27.556230+0000","last_unstale":"2022-03-21T13:54:27.561846+0000","last_undegraded":"2022-03-21T13:54:27.561846+0000","last_fullsized":"2022-03-21T13:54:27.561846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:34:35.624406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562378+0000","last_change":"2022-03-21T13:54:27.559880+0000","last_active":"2022-03-21T13:54:27.562378+0000","last_peered":"2022-03-21T13:54:27.562378+0000","last_clean":"2022-03-21T13:54:27.562378+0000","last_became_active":"2022-03-21T13:54:27.559587+0000","last_became_peered":"2022-03-21T13:54:27.559587+0000","last_unstale":"2022-03-21T13:54:27.562378+0000","last_undegraded":"2022-03-21T13:54:27.562378+0000","last_fullsized":"2022-03-21T13:54:27.562378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:25:15.705881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561513+0000","last_change":"2022-03-21T13:54:27.558473+0000","last_active":"2022-03-21T13:54:27.561513+0000","last_peered":"2022-03-21T13:54:27.561513+0000","last_clean":"2022-03-21T13:54:27.561513+0000","last_became_active":"2022-03-21T13:54:27.557800+0000","last_became_peered":"2022-03-21T13:54:27.557800+0000","last_unstale":"2022-03-21T13:54:27.561513+0000","last_undegraded":"2022-03-21T13:54:27.561513+0000","last_fullsized":"2022-03-21T13:54:27.561513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:43:47.336190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566631+0000","last_change":"2022-03-21T13:54:27.565260+0000","last_active":"2022-03-21T13:54:27.566631+0000","last_peered":"2022-03-21T13:54:27.566631+0000","last_clean":"2022-03-21T13:54:27.566631+0000","last_became_active":"2022-03-21T13:54:27.564955+0000","last_became_peered":"2022-03-21T13:54:27.564955+0000","last_unstale":"2022-03-21T13:54:27.566631+0000","last_undegraded":"2022-03-21T13:54:27.566631+0000","last_fullsized":"2022-03-21T13:54:27.566631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T13:54:36.332945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561411+0000","last_change":"2022-03-21T13:54:27.558826+0000","last_active":"2022-03-21T13:54:27.561411+0000","last_peered":"2022-03-21T13:54:27.561411+0000","last_clean":"2022-03-21T13:54:27.561411+0000","last_became_active":"2022-03-21T13:54:27.558001+0000","last_became_peered":"2022-03-21T13:54:27.558001+0000","last_unstale":"2022-03-21T13:54:27.561411+0000","last_undegraded":"2022-03-21T13:54:27.561411+0000","last_fullsized":"2022-03-21T13:54:27.561411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:09:43.452276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561416+0000","last_change":"2022-03-21T13:54:27.556666+0000","last_active":"2022-03-21T13:54:27.561416+0000","last_peered":"2022-03-21T13:54:27.561416+0000","last_clean":"2022-03-21T13:54:27.561416+0000","last_became_active":"2022-03-21T13:54:27.556355+0000","last_became_peered":"2022-03-21T13:54:27.556355+0000","last_unstale":"2022-03-21T13:54:27.561416+0000","last_undegraded":"2022-03-21T13:54:27.561416+0000","last_fullsized":"2022-03-21T13:54:27.561416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:50:08.704449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561401+0000","last_change":"2022-03-21T13:54:27.558635+0000","last_active":"2022-03-21T13:54:27.561401+0000","last_peered":"2022-03-21T13:54:27.561401+0000","last_clean":"2022-03-21T13:54:27.561401+0000","last_became_active":"2022-03-21T13:54:27.558320+0000","last_became_peered":"2022-03-21T13:54:27.558320+0000","last_unstale":"2022-03-21T13:54:27.561401+0000","last_undegraded":"2022-03-21T13:54:27.561401+0000","last_fullsized":"2022-03-21T13:54:27.561401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:14:17.971078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562412+0000","last_change":"2022-03-21T13:54:27.557412+0000","last_active":"2022-03-21T13:54:27.562412+0000","last_peered":"2022-03-21T13:54:27.562412+0000","last_clean":"2022-03-21T13:54:27.562412+0000","last_became_active":"2022-03-21T13:54:27.557140+0000","last_became_peered":"2022-03-21T13:54:27.557140+0000","last_unstale":"2022-03-21T13:54:27.562412+0000","last_undegraded":"2022-03-21T13:54:27.562412+0000","last_fullsized":"2022-03-21T13:54:27.562412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:14:32.888607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556264+0000","last_change":"2022-03-21T13:54:27.553441+0000","last_active":"2022-03-21T13:54:27.556264+0000","last_peered":"2022-03-21T13:54:27.556264+0000","last_clean":"2022-03-21T13:54:27.556264+0000","last_became_active":"2022-03-21T13:54:27.553027+0000","last_became_peered":"2022-03-21T13:54:27.553027+0000","last_unstale":"2022-03-21T13:54:27.556264+0000","last_undegraded":"2022-03-21T13:54:27.556264+0000","last_fullsized":"2022-03-21T13:54:27.556264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:18:30.624463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566609+0000","last_change":"2022-03-21T13:54:27.563794+0000","last_active":"2022-03-21T13:54:27.566609+0000","last_peered":"2022-03-21T13:54:27.566609+0000","last_clean":"2022-03-21T13:54:27.566609+0000","last_became_active":"2022-03-21T13:54:27.563545+0000","last_became_peered":"2022-03-21T13:54:27.563545+0000","last_unstale":"2022-03-21T13:54:27.566609+0000","last_undegraded":"2022-03-21T13:54:27.566609+0000","last_fullsized":"2022-03-21T13:54:27.566609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:50:55.275326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561275+0000","last_change":"2022-03-21T13:54:27.553387+0000","last_active":"2022-03-21T13:54:27.561275+0000","last_peered":"2022-03-21T13:54:27.561275+0000","last_clean":"2022-03-21T13:54:27.561275+0000","last_became_active":"2022-03-21T13:54:27.553153+0000","last_became_peered":"2022-03-21T13:54:27.553153+0000","last_unstale":"2022-03-21T13:54:27.561275+0000","last_undegraded":"2022-03-21T13:54:27.561275+0000","last_fullsized":"2022-03-21T13:54:27.561275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:50:23.006803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.565877+0000","last_change":"2022-03-21T13:54:27.563751+0000","last_active":"2022-03-21T13:54:27.565877+0000","last_peered":"2022-03-21T13:54:27.565877+0000","last_clean":"2022-03-21T13:54:27.565877+0000","last_became_active":"2022-03-21T13:54:27.563500+0000","last_became_peered":"2022-03-21T13:54:27.563500+0000","last_unstale":"2022-03-21T13:54:27.565877+0000","last_undegraded":"2022-03-21T13:54:27.565877+0000","last_fullsized":"2022-03-21T13:54:27.565877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:56:25.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566301+0000","last_change":"2022-03-21T13:54:27.558999+0000","last_active":"2022-03-21T13:54:27.566301+0000","last_peered":"2022-03-21T13:54:27.566301+0000","last_clean":"2022-03-21T13:54:27.566301+0000","last_became_active":"2022-03-21T13:54:27.558681+0000","last_became_peered":"2022-03-21T13:54:27.558681+0000","last_unstale":"2022-03-21T13:54:27.566301+0000","last_undegraded":"2022-03-21T13:54:27.566301+0000","last_fullsized":"2022-03-21T13:54:27.566301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:42:26.014896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552966+0000","last_change":"2022-03-21T13:54:27.550096+0000","last_active":"2022-03-21T13:54:27.552966+0000","last_peered":"2022-03-21T13:54:27.552966+0000","last_clean":"2022-03-21T13:54:27.552966+0000","last_became_active":"2022-03-21T13:54:27.549821+0000","last_became_peered":"2022-03-21T13:54:27.549821+0000","last_unstale":"2022-03-21T13:54:27.552966+0000","last_undegraded":"2022-03-21T13:54:27.552966+0000","last_fullsized":"2022-03-21T13:54:27.552966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:32:24.498709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563579+0000","last_change":"2022-03-21T13:54:27.561032+0000","last_active":"2022-03-21T13:54:27.563579+0000","last_peered":"2022-03-21T13:54:27.563579+0000","last_clean":"2022-03-21T13:54:27.563579+0000","last_became_active":"2022-03-21T13:54:27.560494+0000","last_became_peered":"2022-03-21T13:54:27.560494+0000","last_unstale":"2022-03-21T13:54:27.563579+0000","last_undegraded":"2022-03-21T13:54:27.563579+0000","last_fullsized":"2022-03-21T13:54:27.563579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:25:56.396980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561291+0000","last_change":"2022-03-21T13:54:27.558917+0000","last_active":"2022-03-21T13:54:27.561291+0000","last_peered":"2022-03-21T13:54:27.561291+0000","last_clean":"2022-03-21T13:54:27.561291+0000","last_became_active":"2022-03-21T13:54:27.556966+0000","last_became_peered":"2022-03-21T13:54:27.556966+0000","last_unstale":"2022-03-21T13:54:27.561291+0000","last_undegraded":"2022-03-21T13:54:27.561291+0000","last_fullsized":"2022-03-21T13:54:27.561291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:43:43.072254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:29.751955+0000","last_change":"2022-03-21T13:54:27.180549+0000","last_active":"2022-03-21T13:54:29.751955+0000","last_peered":"2022-03-21T13:54:29.751955+0000","last_clean":"2022-03-21T13:54:29.751955+0000","last_became_active":"2022-03-21T13:54:27.178977+0000","last_became_peered":"2022-03-21T13:54:27.178977+0000","last_unstale":"2022-03-21T13:54:29.751955+0000","last_undegraded":"2022-03-21T13:54:29.751955+0000","last_fullsized":"2022-03-21T13:54:29.751955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:11:42.262563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553642+0000","last_change":"2022-03-21T13:54:27.546371+0000","last_active":"2022-03-21T13:54:27.553642+0000","last_peered":"2022-03-21T13:54:27.553642+0000","last_clean":"2022-03-21T13:54:27.553642+0000","last_became_active":"2022-03-21T13:54:27.546107+0000","last_became_peered":"2022-03-21T13:54:27.546107+0000","last_unstale":"2022-03-21T13:54:27.553642+0000","last_undegraded":"2022-03-21T13:54:27.553642+0000","last_fullsized":"2022-03-21T13:54:27.553642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:03:31.464752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546952+0000","last_change":"2022-03-21T13:54:27.184281+0000","last_active":"2022-03-21T13:54:27.546952+0000","last_peered":"2022-03-21T13:54:27.546952+0000","last_clean":"2022-03-21T13:54:27.546952+0000","last_became_active":"2022-03-21T13:54:27.183982+0000","last_became_peered":"2022-03-21T13:54:27.183982+0000","last_unstale":"2022-03-21T13:54:27.546952+0000","last_undegraded":"2022-03-21T13:54:27.546952+0000","last_fullsized":"2022-03-21T13:54:27.546952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:05:10.462607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564746+0000","last_change":"2022-03-21T13:54:27.561606+0000","last_active":"2022-03-21T13:54:27.564746+0000","last_peered":"2022-03-21T13:54:27.564746+0000","last_clean":"2022-03-21T13:54:27.564746+0000","last_became_active":"2022-03-21T13:54:27.557656+0000","last_became_peered":"2022-03-21T13:54:27.557656+0000","last_unstale":"2022-03-21T13:54:27.564746+0000","last_undegraded":"2022-03-21T13:54:27.564746+0000","last_fullsized":"2022-03-21T13:54:27.564746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:18:31.529342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538741+0000","last_change":"2022-03-21T13:54:27.181800+0000","last_active":"2022-03-21T13:54:27.538741+0000","last_peered":"2022-03-21T13:54:27.538741+0000","last_clean":"2022-03-21T13:54:27.538741+0000","last_became_active":"2022-03-21T13:54:27.181378+0000","last_became_peered":"2022-03-21T13:54:27.181378+0000","last_unstale":"2022-03-21T13:54:27.538741+0000","last_undegraded":"2022-03-21T13:54:27.538741+0000","last_fullsized":"2022-03-21T13:54:27.538741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T13:59:13.837451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553680+0000","last_change":"2022-03-21T13:54:27.547987+0000","last_active":"2022-03-21T13:54:27.553680+0000","last_peered":"2022-03-21T13:54:27.553680+0000","last_clean":"2022-03-21T13:54:27.553680+0000","last_became_active":"2022-03-21T13:54:27.547719+0000","last_became_peered":"2022-03-21T13:54:27.547719+0000","last_unstale":"2022-03-21T13:54:27.553680+0000","last_undegraded":"2022-03-21T13:54:27.553680+0000","last_fullsized":"2022-03-21T13:54:27.553680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:20:42.860191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.548892+0000","last_change":"2022-03-21T13:54:27.177649+0000","last_active":"2022-03-21T13:54:27.548892+0000","last_peered":"2022-03-21T13:54:27.548892+0000","last_clean":"2022-03-21T13:54:27.548892+0000","last_became_active":"2022-03-21T13:54:27.176925+0000","last_became_peered":"2022-03-21T13:54:27.176925+0000","last_unstale":"2022-03-21T13:54:27.548892+0000","last_undegraded":"2022-03-21T13:54:27.548892+0000","last_fullsized":"2022-03-21T13:54:27.548892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:05:31.974802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.555060+0000","last_change":"2022-03-21T13:54:27.553129+0000","last_active":"2022-03-21T13:54:27.555060+0000","last_peered":"2022-03-21T13:54:27.555060+0000","last_clean":"2022-03-21T13:54:27.555060+0000","last_became_active":"2022-03-21T13:54:27.552857+0000","last_became_peered":"2022-03-21T13:54:27.552857+0000","last_unstale":"2022-03-21T13:54:27.555060+0000","last_undegraded":"2022-03-21T13:54:27.555060+0000","last_fullsized":"2022-03-21T13:54:27.555060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:49:43.458618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.540230+0000","last_change":"2022-03-21T13:54:27.176726+0000","last_active":"2022-03-21T13:54:27.540230+0000","last_peered":"2022-03-21T13:54:27.540230+0000","last_clean":"2022-03-21T13:54:27.540230+0000","last_became_active":"2022-03-21T13:54:27.176464+0000","last_became_peered":"2022-03-21T13:54:27.176464+0000","last_unstale":"2022-03-21T13:54:27.540230+0000","last_undegraded":"2022-03-21T13:54:27.540230+0000","last_fullsized":"2022-03-21T13:54:27.540230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:01:07.573227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557296+0000","last_change":"2022-03-21T13:54:27.555953+0000","last_active":"2022-03-21T13:54:27.557296+0000","last_peered":"2022-03-21T13:54:27.557296+0000","last_clean":"2022-03-21T13:54:27.557296+0000","last_became_active":"2022-03-21T13:54:27.555697+0000","last_became_peered":"2022-03-21T13:54:27.555697+0000","last_unstale":"2022-03-21T13:54:27.557296+0000","last_undegraded":"2022-03-21T13:54:27.557296+0000","last_fullsized":"2022-03-21T13:54:27.557296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:04:28.623659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.545472+0000","last_change":"2022-03-21T13:54:27.181859+0000","last_active":"2022-03-21T13:54:32.545472+0000","last_peered":"2022-03-21T13:54:32.545472+0000","last_clean":"2022-03-21T13:54:32.545472+0000","last_became_active":"2022-03-21T13:54:27.181629+0000","last_became_peered":"2022-03-21T13:54:27.181629+0000","last_unstale":"2022-03-21T13:54:32.545472+0000","last_undegraded":"2022-03-21T13:54:32.545472+0000","last_fullsized":"2022-03-21T13:54:32.545472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:24:23.689696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553010+0000","last_change":"2022-03-21T13:54:27.549413+0000","last_active":"2022-03-21T13:54:27.553010+0000","last_peered":"2022-03-21T13:54:27.553010+0000","last_clean":"2022-03-21T13:54:27.553010+0000","last_became_active":"2022-03-21T13:54:27.549162+0000","last_became_peered":"2022-03-21T13:54:27.549162+0000","last_unstale":"2022-03-21T13:54:27.553010+0000","last_undegraded":"2022-03-21T13:54:27.553010+0000","last_fullsized":"2022-03-21T13:54:27.553010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:06:56.454596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547977+0000","last_change":"2022-03-21T13:54:27.181484+0000","last_active":"2022-03-21T13:54:32.547977+0000","last_peered":"2022-03-21T13:54:32.547977+0000","last_clean":"2022-03-21T13:54:32.547977+0000","last_became_active":"2022-03-21T13:54:27.181191+0000","last_became_peered":"2022-03-21T13:54:27.181191+0000","last_unstale":"2022-03-21T13:54:32.547977+0000","last_undegraded":"2022-03-21T13:54:32.547977+0000","last_fullsized":"2022-03-21T13:54:32.547977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:10:19.939317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554603+0000","last_change":"2022-03-21T13:54:27.547927+0000","last_active":"2022-03-21T13:54:27.554603+0000","last_peered":"2022-03-21T13:54:27.554603+0000","last_clean":"2022-03-21T13:54:27.554603+0000","last_became_active":"2022-03-21T13:54:27.547605+0000","last_became_peered":"2022-03-21T13:54:27.547605+0000","last_unstale":"2022-03-21T13:54:27.554603+0000","last_undegraded":"2022-03-21T13:54:27.554603+0000","last_fullsized":"2022-03-21T13:54:27.554603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:57:24.920256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547299+0000","last_change":"2022-03-21T13:54:27.183437+0000","last_active":"2022-03-21T13:54:32.547299+0000","last_peered":"2022-03-21T13:54:32.547299+0000","last_clean":"2022-03-21T13:54:32.547299+0000","last_became_active":"2022-03-21T13:54:27.183118+0000","last_became_peered":"2022-03-21T13:54:27.183118+0000","last_unstale":"2022-03-21T13:54:32.547299+0000","last_undegraded":"2022-03-21T13:54:32.547299+0000","last_fullsized":"2022-03-21T13:54:32.547299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:46:16.301549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556401+0000","last_change":"2022-03-21T13:54:27.553692+0000","last_active":"2022-03-21T13:54:27.556401+0000","last_peered":"2022-03-21T13:54:27.556401+0000","last_clean":"2022-03-21T13:54:27.556401+0000","last_became_active":"2022-03-21T13:54:27.553419+0000","last_became_peered":"2022-03-21T13:54:27.553419+0000","last_unstale":"2022-03-21T13:54:27.556401+0000","last_undegraded":"2022-03-21T13:54:27.556401+0000","last_fullsized":"2022-03-21T13:54:27.556401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:47:02.533721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.541256+0000","last_change":"2022-03-21T13:54:27.179452+0000","last_active":"2022-03-21T13:54:27.541256+0000","last_peered":"2022-03-21T13:54:27.541256+0000","last_clean":"2022-03-21T13:54:27.541256+0000","last_became_active":"2022-03-21T13:54:27.177655+0000","last_became_peered":"2022-03-21T13:54:27.177655+0000","last_unstale":"2022-03-21T13:54:27.541256+0000","last_undegraded":"2022-03-21T13:54:27.541256+0000","last_fullsized":"2022-03-21T13:54:27.541256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:42:43.049495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561270+0000","last_change":"2022-03-21T13:54:27.557989+0000","last_active":"2022-03-21T13:54:27.561270+0000","last_peered":"2022-03-21T13:54:27.561270+0000","last_clean":"2022-03-21T13:54:27.561270+0000","last_became_active":"2022-03-21T13:54:27.557346+0000","last_became_peered":"2022-03-21T13:54:27.557346+0000","last_unstale":"2022-03-21T13:54:27.561270+0000","last_undegraded":"2022-03-21T13:54:27.561270+0000","last_fullsized":"2022-03-21T13:54:27.561270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:54:09.949225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552575+0000","last_change":"2022-03-21T13:54:27.177423+0000","last_active":"2022-03-21T13:54:27.552575+0000","last_peered":"2022-03-21T13:54:27.552575+0000","last_clean":"2022-03-21T13:54:27.552575+0000","last_became_active":"2022-03-21T13:54:27.177050+0000","last_became_peered":"2022-03-21T13:54:27.177050+0000","last_unstale":"2022-03-21T13:54:27.552575+0000","last_undegraded":"2022-03-21T13:54:27.552575+0000","last_fullsized":"2022-03-21T13:54:27.552575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:03:05.301157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564724+0000","last_change":"2022-03-21T13:54:27.557999+0000","last_active":"2022-03-21T13:54:27.564724+0000","last_peered":"2022-03-21T13:54:27.564724+0000","last_clean":"2022-03-21T13:54:27.564724+0000","last_became_active":"2022-03-21T13:54:27.557001+0000","last_became_peered":"2022-03-21T13:54:27.557001+0000","last_unstale":"2022-03-21T13:54:27.564724+0000","last_undegraded":"2022-03-21T13:54:27.564724+0000","last_fullsized":"2022-03-21T13:54:27.564724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:44:28.857826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547325+0000","last_change":"2022-03-21T13:54:27.184135+0000","last_active":"2022-03-21T13:54:32.547325+0000","last_peered":"2022-03-21T13:54:32.547325+0000","last_clean":"2022-03-21T13:54:32.547325+0000","last_became_active":"2022-03-21T13:54:27.183892+0000","last_became_peered":"2022-03-21T13:54:27.183892+0000","last_unstale":"2022-03-21T13:54:32.547325+0000","last_undegraded":"2022-03-21T13:54:32.547325+0000","last_fullsized":"2022-03-21T13:54:32.547325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:44:30.017340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564841+0000","last_change":"2022-03-21T13:54:27.559857+0000","last_active":"2022-03-21T13:54:27.564841+0000","last_peered":"2022-03-21T13:54:27.564841+0000","last_clean":"2022-03-21T13:54:27.564841+0000","last_became_active":"2022-03-21T13:54:27.559336+0000","last_became_peered":"2022-03-21T13:54:27.559336+0000","last_unstale":"2022-03-21T13:54:27.564841+0000","last_undegraded":"2022-03-21T13:54:27.564841+0000","last_fullsized":"2022-03-21T13:54:27.564841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:43:12.014350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:30.900451+0000","last_change":"2022-03-21T13:54:27.178818+0000","last_active":"2022-03-21T13:54:30.900451+0000","last_peered":"2022-03-21T13:54:30.900451+0000","last_clean":"2022-03-21T13:54:30.900451+0000","last_became_active":"2022-03-21T13:54:27.178542+0000","last_became_peered":"2022-03-21T13:54:27.178542+0000","last_unstale":"2022-03-21T13:54:30.900451+0000","last_undegraded":"2022-03-21T13:54:30.900451+0000","last_fullsized":"2022-03-21T13:54:30.900451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:45:39.568015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.560603+0000","last_change":"2022-03-21T13:54:27.555377+0000","last_active":"2022-03-21T13:54:27.560603+0000","last_peered":"2022-03-21T13:54:27.560603+0000","last_clean":"2022-03-21T13:54:27.560603+0000","last_became_active":"2022-03-21T13:54:27.555080+0000","last_became_peered":"2022-03-21T13:54:27.555080+0000","last_unstale":"2022-03-21T13:54:27.560603+0000","last_undegraded":"2022-03-21T13:54:27.560603+0000","last_fullsized":"2022-03-21T13:54:27.560603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:16:31.684909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547235+0000","last_change":"2022-03-21T13:54:27.175755+0000","last_active":"2022-03-21T13:54:32.547235+0000","last_peered":"2022-03-21T13:54:32.547235+0000","last_clean":"2022-03-21T13:54:32.547235+0000","last_became_active":"2022-03-21T13:54:27.175442+0000","last_became_peered":"2022-03-21T13:54:27.175442+0000","last_unstale":"2022-03-21T13:54:32.547235+0000","last_undegraded":"2022-03-21T13:54:32.547235+0000","last_fullsized":"2022-03-21T13:54:32.547235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:21:41.935690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559410+0000","last_change":"2022-03-21T13:54:27.555167+0000","last_active":"2022-03-21T13:54:27.559410+0000","last_peered":"2022-03-21T13:54:27.559410+0000","last_clean":"2022-03-21T13:54:27.559410+0000","last_became_active":"2022-03-21T13:54:27.554856+0000","last_became_peered":"2022-03-21T13:54:27.554856+0000","last_unstale":"2022-03-21T13:54:27.559410+0000","last_undegraded":"2022-03-21T13:54:27.559410+0000","last_fullsized":"2022-03-21T13:54:27.559410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:57:23.684151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:30.900339+0000","last_change":"2022-03-21T13:54:27.176740+0000","last_active":"2022-03-21T13:54:30.900339+0000","last_peered":"2022-03-21T13:54:30.900339+0000","last_clean":"2022-03-21T13:54:30.900339+0000","last_became_active":"2022-03-21T13:54:27.176438+0000","last_became_peered":"2022-03-21T13:54:27.176438+0000","last_unstale":"2022-03-21T13:54:30.900339+0000","last_undegraded":"2022-03-21T13:54:30.900339+0000","last_fullsized":"2022-03-21T13:54:30.900339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:30:43.910676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.549588+0000","last_change":"2022-03-21T13:54:27.546515+0000","last_active":"2022-03-21T13:54:27.549588+0000","last_peered":"2022-03-21T13:54:27.549588+0000","last_clean":"2022-03-21T13:54:27.549588+0000","last_became_active":"2022-03-21T13:54:27.546277+0000","last_became_peered":"2022-03-21T13:54:27.546277+0000","last_unstale":"2022-03-21T13:54:27.549588+0000","last_undegraded":"2022-03-21T13:54:27.549588+0000","last_fullsized":"2022-03-21T13:54:27.549588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:55:14.541373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538652+0000","last_change":"2022-03-21T13:54:27.173718+0000","last_active":"2022-03-21T13:54:27.538652+0000","last_peered":"2022-03-21T13:54:27.538652+0000","last_clean":"2022-03-21T13:54:27.538652+0000","last_became_active":"2022-03-21T13:54:27.173384+0000","last_became_peered":"2022-03-21T13:54:27.173384+0000","last_unstale":"2022-03-21T13:54:27.538652+0000","last_undegraded":"2022-03-21T13:54:27.538652+0000","last_fullsized":"2022-03-21T13:54:27.538652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:27:30.485761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561445+0000","last_change":"2022-03-21T13:54:27.553332+0000","last_active":"2022-03-21T13:54:27.561445+0000","last_peered":"2022-03-21T13:54:27.561445+0000","last_clean":"2022-03-21T13:54:27.561445+0000","last_became_active":"2022-03-21T13:54:27.553052+0000","last_became_peered":"2022-03-21T13:54:27.553052+0000","last_unstale":"2022-03-21T13:54:27.561445+0000","last_undegraded":"2022-03-21T13:54:27.561445+0000","last_fullsized":"2022-03-21T13:54:27.561445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:04:17.341255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.542677+0000","last_change":"2022-03-21T13:54:27.181423+0000","last_active":"2022-03-21T13:54:32.542677+0000","last_peered":"2022-03-21T13:54:32.542677+0000","last_clean":"2022-03-21T13:54:32.542677+0000","last_became_active":"2022-03-21T13:54:27.181127+0000","last_became_peered":"2022-03-21T13:54:27.181127+0000","last_unstale":"2022-03-21T13:54:32.542677+0000","last_undegraded":"2022-03-21T13:54:32.542677+0000","last_fullsized":"2022-03-21T13:54:32.542677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:17:46.749032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556245+0000","last_change":"2022-03-21T13:54:27.553277+0000","last_active":"2022-03-21T13:54:27.556245+0000","last_peered":"2022-03-21T13:54:27.556245+0000","last_clean":"2022-03-21T13:54:27.556245+0000","last_became_active":"2022-03-21T13:54:27.552711+0000","last_became_peered":"2022-03-21T13:54:27.552711+0000","last_unstale":"2022-03-21T13:54:27.556245+0000","last_undegraded":"2022-03-21T13:54:27.556245+0000","last_fullsized":"2022-03-21T13:54:27.556245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:18:24.656738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.543711+0000","last_change":"2022-03-21T13:54:27.188996+0000","last_active":"2022-03-21T13:54:27.543711+0000","last_peered":"2022-03-21T13:54:27.543711+0000","last_clean":"2022-03-21T13:54:27.543711+0000","last_became_active":"2022-03-21T13:54:27.188638+0000","last_became_peered":"2022-03-21T13:54:27.188638+0000","last_unstale":"2022-03-21T13:54:27.543711+0000","last_undegraded":"2022-03-21T13:54:27.543711+0000","last_fullsized":"2022-03-21T13:54:27.543711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:49:19.960076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561350+0000","last_change":"2022-03-21T13:54:27.557724+0000","last_active":"2022-03-21T13:54:27.561350+0000","last_peered":"2022-03-21T13:54:27.561350+0000","last_clean":"2022-03-21T13:54:27.561350+0000","last_became_active":"2022-03-21T13:54:27.557422+0000","last_became_peered":"2022-03-21T13:54:27.557422+0000","last_unstale":"2022-03-21T13:54:27.561350+0000","last_undegraded":"2022-03-21T13:54:27.561350+0000","last_fullsized":"2022-03-21T13:54:27.561350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:34:17.342191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544789+0000","last_change":"2022-03-21T13:54:27.175632+0000","last_active":"2022-03-21T13:54:27.544789+0000","last_peered":"2022-03-21T13:54:27.544789+0000","last_clean":"2022-03-21T13:54:27.544789+0000","last_became_active":"2022-03-21T13:54:27.174313+0000","last_became_peered":"2022-03-21T13:54:27.174313+0000","last_unstale":"2022-03-21T13:54:27.544789+0000","last_undegraded":"2022-03-21T13:54:27.544789+0000","last_fullsized":"2022-03-21T13:54:27.544789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:31:14.846155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556557+0000","last_change":"2022-03-21T13:54:27.553933+0000","last_active":"2022-03-21T13:54:27.556557+0000","last_peered":"2022-03-21T13:54:27.556557+0000","last_clean":"2022-03-21T13:54:27.556557+0000","last_became_active":"2022-03-21T13:54:27.553667+0000","last_became_peered":"2022-03-21T13:54:27.553667+0000","last_unstale":"2022-03-21T13:54:27.556557+0000","last_undegraded":"2022-03-21T13:54:27.556557+0000","last_fullsized":"2022-03-21T13:54:27.556557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:51:01.974225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538127+0000","last_change":"2022-03-21T13:54:27.181656+0000","last_active":"2022-03-21T13:54:27.538127+0000","last_peered":"2022-03-21T13:54:27.538127+0000","last_clean":"2022-03-21T13:54:27.538127+0000","last_became_active":"2022-03-21T13:54:27.181013+0000","last_became_peered":"2022-03-21T13:54:27.181013+0000","last_unstale":"2022-03-21T13:54:27.538127+0000","last_undegraded":"2022-03-21T13:54:27.538127+0000","last_fullsized":"2022-03-21T13:54:27.538127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:08:16.370281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559632+0000","last_change":"2022-03-21T13:54:27.552507+0000","last_active":"2022-03-21T13:54:27.559632+0000","last_peered":"2022-03-21T13:54:27.559632+0000","last_clean":"2022-03-21T13:54:27.559632+0000","last_became_active":"2022-03-21T13:54:27.552244+0000","last_became_peered":"2022-03-21T13:54:27.552244+0000","last_unstale":"2022-03-21T13:54:27.559632+0000","last_undegraded":"2022-03-21T13:54:27.559632+0000","last_fullsized":"2022-03-21T13:54:27.559632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:15:46.905402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.546403+0000","last_change":"2022-03-21T13:54:27.182220+0000","last_active":"2022-03-21T13:54:32.546403+0000","last_peered":"2022-03-21T13:54:32.546403+0000","last_clean":"2022-03-21T13:54:32.546403+0000","last_became_active":"2022-03-21T13:54:27.181449+0000","last_became_peered":"2022-03-21T13:54:27.181449+0000","last_unstale":"2022-03-21T13:54:32.546403+0000","last_undegraded":"2022-03-21T13:54:32.546403+0000","last_fullsized":"2022-03-21T13:54:32.546403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:26:28.829484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544372+0000","last_change":"2022-03-21T13:54:22.752657+0000","last_active":"2022-03-21T13:54:27.544372+0000","last_peered":"2022-03-21T13:54:27.544372+0000","last_clean":"2022-03-21T13:54:27.544372+0000","last_became_active":"2022-03-21T13:54:22.752340+0000","last_became_peered":"2022-03-21T13:54:22.752340+0000","last_unstale":"2022-03-21T13:54:27.544372+0000","last_undegraded":"2022-03-21T13:54:27.544372+0000","last_fullsized":"2022-03-21T13:54:27.544372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:28:57.302130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559027+0000","last_change":"2022-03-21T13:54:27.556126+0000","last_active":"2022-03-21T13:54:27.559027+0000","last_peered":"2022-03-21T13:54:27.559027+0000","last_clean":"2022-03-21T13:54:27.559027+0000","last_became_active":"2022-03-21T13:54:27.555851+0000","last_became_peered":"2022-03-21T13:54:27.555851+0000","last_unstale":"2022-03-21T13:54:27.559027+0000","last_undegraded":"2022-03-21T13:54:27.559027+0000","last_fullsized":"2022-03-21T13:54:27.559027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:16:33.357705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538747+0000","last_change":"2022-03-21T13:54:22.516271+0000","last_active":"2022-03-21T13:54:27.538747+0000","last_peered":"2022-03-21T13:54:27.538747+0000","last_clean":"2022-03-21T13:54:27.538747+0000","last_became_active":"2022-03-21T13:54:22.516054+0000","last_became_peered":"2022-03-21T13:54:22.516054+0000","last_unstale":"2022-03-21T13:54:27.538747+0000","last_undegraded":"2022-03-21T13:54:27.538747+0000","last_fullsized":"2022-03-21T13:54:27.538747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:22:14.145694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.548707+0000","last_change":"2022-03-21T13:54:27.180161+0000","last_active":"2022-03-21T13:54:27.548707+0000","last_peered":"2022-03-21T13:54:27.548707+0000","last_clean":"2022-03-21T13:54:27.548707+0000","last_became_active":"2022-03-21T13:54:27.179861+0000","last_became_peered":"2022-03-21T13:54:27.179861+0000","last_unstale":"2022-03-21T13:54:27.548707+0000","last_undegraded":"2022-03-21T13:54:27.548707+0000","last_fullsized":"2022-03-21T13:54:27.548707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:54:59.570703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559390+0000","last_change":"2022-03-21T13:54:27.554664+0000","last_active":"2022-03-21T13:54:27.559390+0000","last_peered":"2022-03-21T13:54:27.559390+0000","last_clean":"2022-03-21T13:54:27.559390+0000","last_became_active":"2022-03-21T13:54:27.554348+0000","last_became_peered":"2022-03-21T13:54:27.554348+0000","last_unstale":"2022-03-21T13:54:27.559390+0000","last_undegraded":"2022-03-21T13:54:27.559390+0000","last_fullsized":"2022-03-21T13:54:27.559390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:57:45.927949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546570+0000","last_change":"2022-03-21T13:54:22.517332+0000","last_active":"2022-03-21T13:54:27.546570+0000","last_peered":"2022-03-21T13:54:27.546570+0000","last_clean":"2022-03-21T13:54:27.546570+0000","last_became_active":"2022-03-21T13:54:22.517041+0000","last_became_peered":"2022-03-21T13:54:22.517041+0000","last_unstale":"2022-03-21T13:54:27.546570+0000","last_undegraded":"2022-03-21T13:54:27.546570+0000","last_fullsized":"2022-03-21T13:54:27.546570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:35:30.629523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552331+0000","last_change":"2022-03-21T13:54:22.518907+0000","last_active":"2022-03-21T13:54:27.552331+0000","last_peered":"2022-03-21T13:54:27.552331+0000","last_clean":"2022-03-21T13:54:27.552331+0000","last_became_active":"2022-03-21T13:54:22.518133+0000","last_became_peered":"2022-03-21T13:54:22.518133+0000","last_unstale":"2022-03-21T13:54:27.552331+0000","last_undegraded":"2022-03-21T13:54:27.552331+0000","last_fullsized":"2022-03-21T13:54:27.552331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:30:34.855709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.550369+0000","last_change":"2022-03-21T13:54:27.176117+0000","last_active":"2022-03-21T13:54:27.550369+0000","last_peered":"2022-03-21T13:54:27.550369+0000","last_clean":"2022-03-21T13:54:27.550369+0000","last_became_active":"2022-03-21T13:54:27.175777+0000","last_became_peered":"2022-03-21T13:54:27.175777+0000","last_unstale":"2022-03-21T13:54:27.550369+0000","last_undegraded":"2022-03-21T13:54:27.550369+0000","last_fullsized":"2022-03-21T13:54:27.550369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:10:54.616279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564761+0000","last_change":"2022-03-21T13:54:27.557887+0000","last_active":"2022-03-21T13:54:27.564761+0000","last_peered":"2022-03-21T13:54:27.564761+0000","last_clean":"2022-03-21T13:54:27.564761+0000","last_became_active":"2022-03-21T13:54:27.556863+0000","last_became_peered":"2022-03-21T13:54:27.556863+0000","last_unstale":"2022-03-21T13:54:27.564761+0000","last_undegraded":"2022-03-21T13:54:27.564761+0000","last_fullsized":"2022-03-21T13:54:27.564761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:12:33.174945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552437+0000","last_change":"2022-03-21T13:54:22.754462+0000","last_active":"2022-03-21T13:54:27.552437+0000","last_peered":"2022-03-21T13:54:27.552437+0000","last_clean":"2022-03-21T13:54:27.552437+0000","last_became_active":"2022-03-21T13:54:22.754181+0000","last_became_peered":"2022-03-21T13:54:22.754181+0000","last_unstale":"2022-03-21T13:54:27.552437+0000","last_undegraded":"2022-03-21T13:54:27.552437+0000","last_fullsized":"2022-03-21T13:54:27.552437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:14:20.288360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.545206+0000","last_change":"2022-03-21T13:54:27.179213+0000","last_active":"2022-03-21T13:54:27.545206+0000","last_peered":"2022-03-21T13:54:27.545206+0000","last_clean":"2022-03-21T13:54:27.545206+0000","last_became_active":"2022-03-21T13:54:27.178915+0000","last_became_peered":"2022-03-21T13:54:27.178915+0000","last_unstale":"2022-03-21T13:54:27.545206+0000","last_undegraded":"2022-03-21T13:54:27.545206+0000","last_fullsized":"2022-03-21T13:54:27.545206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:13:42.024350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552944+0000","last_change":"2022-03-21T13:54:27.547854+0000","last_active":"2022-03-21T13:54:27.552944+0000","last_peered":"2022-03-21T13:54:27.552944+0000","last_clean":"2022-03-21T13:54:27.552944+0000","last_became_active":"2022-03-21T13:54:27.547604+0000","last_became_peered":"2022-03-21T13:54:27.547604+0000","last_unstale":"2022-03-21T13:54:27.552944+0000","last_undegraded":"2022-03-21T13:54:27.552944+0000","last_fullsized":"2022-03-21T13:54:27.552944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:32:19.271632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552230+0000","last_change":"2022-03-21T13:54:22.754729+0000","last_active":"2022-03-21T13:54:27.552230+0000","last_peered":"2022-03-21T13:54:27.552230+0000","last_clean":"2022-03-21T13:54:27.552230+0000","last_became_active":"2022-03-21T13:54:22.754461+0000","last_became_peered":"2022-03-21T13:54:22.754461+0000","last_unstale":"2022-03-21T13:54:27.552230+0000","last_undegraded":"2022-03-21T13:54:27.552230+0000","last_fullsized":"2022-03-21T13:54:27.552230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:46:22.855169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538243+0000","last_change":"2022-03-21T13:54:27.174663+0000","last_active":"2022-03-21T13:54:27.538243+0000","last_peered":"2022-03-21T13:54:27.538243+0000","last_clean":"2022-03-21T13:54:27.538243+0000","last_became_active":"2022-03-21T13:54:27.174374+0000","last_became_peered":"2022-03-21T13:54:27.174374+0000","last_unstale":"2022-03-21T13:54:27.538243+0000","last_undegraded":"2022-03-21T13:54:27.538243+0000","last_fullsized":"2022-03-21T13:54:27.538243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:56:26.094511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561738+0000","last_change":"2022-03-21T13:54:27.554233+0000","last_active":"2022-03-21T13:54:27.561738+0000","last_peered":"2022-03-21T13:54:27.561738+0000","last_clean":"2022-03-21T13:54:27.561738+0000","last_became_active":"2022-03-21T13:54:27.554000+0000","last_became_peered":"2022-03-21T13:54:27.554000+0000","last_unstale":"2022-03-21T13:54:27.561738+0000","last_undegraded":"2022-03-21T13:54:27.561738+0000","last_fullsized":"2022-03-21T13:54:27.561738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:06:56.350790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.539757+0000","last_change":"2022-03-21T13:54:22.754834+0000","last_active":"2022-03-21T13:54:27.539757+0000","last_peered":"2022-03-21T13:54:27.539757+0000","last_clean":"2022-03-21T13:54:27.539757+0000","last_became_active":"2022-03-21T13:54:22.754559+0000","last_became_peered":"2022-03-21T13:54:22.754559+0000","last_unstale":"2022-03-21T13:54:27.539757+0000","last_undegraded":"2022-03-21T13:54:27.539757+0000","last_fullsized":"2022-03-21T13:54:27.539757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:12:50.878537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544326+0000","last_change":"2022-03-21T13:54:27.181111+0000","last_active":"2022-03-21T13:54:27.544326+0000","last_peered":"2022-03-21T13:54:27.544326+0000","last_clean":"2022-03-21T13:54:27.544326+0000","last_became_active":"2022-03-21T13:54:27.180843+0000","last_became_peered":"2022-03-21T13:54:27.180843+0000","last_unstale":"2022-03-21T13:54:27.544326+0000","last_undegraded":"2022-03-21T13:54:27.544326+0000","last_fullsized":"2022-03-21T13:54:27.544326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:59:38.064620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563441+0000","last_change":"2022-03-21T13:54:27.559540+0000","last_active":"2022-03-21T13:54:27.563441+0000","last_peered":"2022-03-21T13:54:27.563441+0000","last_clean":"2022-03-21T13:54:27.563441+0000","last_became_active":"2022-03-21T13:54:27.559138+0000","last_became_peered":"2022-03-21T13:54:27.559138+0000","last_unstale":"2022-03-21T13:54:27.563441+0000","last_undegraded":"2022-03-21T13:54:27.563441+0000","last_fullsized":"2022-03-21T13:54:27.563441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:00:54.639756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.543099+0000","last_change":"2022-03-21T13:54:22.754654+0000","last_active":"2022-03-21T13:54:27.543099+0000","last_peered":"2022-03-21T13:54:27.543099+0000","last_clean":"2022-03-21T13:54:27.543099+0000","last_became_active":"2022-03-21T13:54:22.754341+0000","last_became_peered":"2022-03-21T13:54:22.754341+0000","last_unstale":"2022-03-21T13:54:27.543099+0000","last_undegraded":"2022-03-21T13:54:27.543099+0000","last_fullsized":"2022-03-21T13:54:27.543099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:03:23.378195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.545941+0000","last_change":"2022-03-21T13:54:27.177438+0000","last_active":"2022-03-21T13:54:27.545941+0000","last_peered":"2022-03-21T13:54:27.545941+0000","last_clean":"2022-03-21T13:54:27.545941+0000","last_became_active":"2022-03-21T13:54:27.177162+0000","last_became_peered":"2022-03-21T13:54:27.177162+0000","last_unstale":"2022-03-21T13:54:27.545941+0000","last_undegraded":"2022-03-21T13:54:27.545941+0000","last_fullsized":"2022-03-21T13:54:27.545941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:28:43.052052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564772+0000","last_change":"2022-03-21T13:54:27.561906+0000","last_active":"2022-03-21T13:54:27.564772+0000","last_peered":"2022-03-21T13:54:27.564772+0000","last_clean":"2022-03-21T13:54:27.564772+0000","last_became_active":"2022-03-21T13:54:27.561625+0000","last_became_peered":"2022-03-21T13:54:27.561625+0000","last_unstale":"2022-03-21T13:54:27.564772+0000","last_undegraded":"2022-03-21T13:54:27.564772+0000","last_fullsized":"2022-03-21T13:54:27.564772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:56:25.047015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.543299+0000","last_change":"2022-03-21T13:54:22.516420+0000","last_active":"2022-03-21T13:54:27.543299+0000","last_peered":"2022-03-21T13:54:27.543299+0000","last_clean":"2022-03-21T13:54:27.543299+0000","last_became_active":"2022-03-21T13:54:22.516110+0000","last_became_peered":"2022-03-21T13:54:22.516110+0000","last_unstale":"2022-03-21T13:54:27.543299+0000","last_undegraded":"2022-03-21T13:54:27.543299+0000","last_fullsized":"2022-03-21T13:54:27.543299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:05:13.607013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.539334+0000","last_change":"2022-03-21T13:54:27.173580+0000","last_active":"2022-03-21T13:54:27.539334+0000","last_peered":"2022-03-21T13:54:27.539334+0000","last_clean":"2022-03-21T13:54:27.539334+0000","last_became_active":"2022-03-21T13:54:27.173258+0000","last_became_peered":"2022-03-21T13:54:27.173258+0000","last_unstale":"2022-03-21T13:54:27.539334+0000","last_undegraded":"2022-03-21T13:54:27.539334+0000","last_fullsized":"2022-03-21T13:54:27.539334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:47:44.915765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552991+0000","last_change":"2022-03-21T13:54:27.548735+0000","last_active":"2022-03-21T13:54:27.552991+0000","last_peered":"2022-03-21T13:54:27.552991+0000","last_clean":"2022-03-21T13:54:27.552991+0000","last_became_active":"2022-03-21T13:54:27.548473+0000","last_became_peered":"2022-03-21T13:54:27.548473+0000","last_unstale":"2022-03-21T13:54:27.552991+0000","last_undegraded":"2022-03-21T13:54:27.552991+0000","last_fullsized":"2022-03-21T13:54:27.552991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:39:55.442576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:30.899423+0000","last_change":"2022-03-21T13:54:27.189213+0000","last_active":"2022-03-21T13:54:30.899423+0000","last_peered":"2022-03-21T13:54:30.899423+0000","last_clean":"2022-03-21T13:54:30.899423+0000","last_became_active":"2022-03-21T13:54:27.188926+0000","last_became_peered":"2022-03-21T13:54:27.188926+0000","last_unstale":"2022-03-21T13:54:30.899423+0000","last_undegraded":"2022-03-21T13:54:30.899423+0000","last_fullsized":"2022-03-21T13:54:30.899423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:16:55.866231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561826+0000","last_change":"2022-03-21T13:54:27.556471+0000","last_active":"2022-03-21T13:54:27.561826+0000","last_peered":"2022-03-21T13:54:27.561826+0000","last_clean":"2022-03-21T13:54:27.561826+0000","last_became_active":"2022-03-21T13:54:27.556191+0000","last_became_peered":"2022-03-21T13:54:27.556191+0000","last_unstale":"2022-03-21T13:54:27.561826+0000","last_undegraded":"2022-03-21T13:54:27.561826+0000","last_fullsized":"2022-03-21T13:54:27.561826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:05:34.443958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547761+0000","last_change":"2022-03-21T13:54:27.177405+0000","last_active":"2022-03-21T13:54:32.547761+0000","last_peered":"2022-03-21T13:54:32.547761+0000","last_clean":"2022-03-21T13:54:32.547761+0000","last_became_active":"2022-03-21T13:54:27.177179+0000","last_became_peered":"2022-03-21T13:54:27.177179+0000","last_unstale":"2022-03-21T13:54:32.547761+0000","last_undegraded":"2022-03-21T13:54:32.547761+0000","last_fullsized":"2022-03-21T13:54:32.547761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:41:46.492410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556386+0000","last_change":"2022-03-21T13:54:27.552397+0000","last_active":"2022-03-21T13:54:27.556386+0000","last_peered":"2022-03-21T13:54:27.556386+0000","last_clean":"2022-03-21T13:54:27.556386+0000","last_became_active":"2022-03-21T13:54:27.552124+0000","last_became_peered":"2022-03-21T13:54:27.552124+0000","last_unstale":"2022-03-21T13:54:27.556386+0000","last_undegraded":"2022-03-21T13:54:27.556386+0000","last_fullsized":"2022-03-21T13:54:27.556386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:53:44.559771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547691+0000","last_change":"2022-03-21T13:54:27.174486+0000","last_active":"2022-03-21T13:54:32.547691+0000","last_peered":"2022-03-21T13:54:32.547691+0000","last_clean":"2022-03-21T13:54:32.547691+0000","last_became_active":"2022-03-21T13:54:27.174216+0000","last_became_peered":"2022-03-21T13:54:27.174216+0000","last_unstale":"2022-03-21T13:54:32.547691+0000","last_undegraded":"2022-03-21T13:54:32.547691+0000","last_fullsized":"2022-03-21T13:54:32.547691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:48:33.845336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552669+0000","last_change":"2022-03-21T13:54:27.545286+0000","last_active":"2022-03-21T13:54:27.552669+0000","last_peered":"2022-03-21T13:54:27.552669+0000","last_clean":"2022-03-21T13:54:27.552669+0000","last_became_active":"2022-03-21T13:54:27.544961+0000","last_became_peered":"2022-03-21T13:54:27.544961+0000","last_unstale":"2022-03-21T13:54:27.552669+0000","last_undegraded":"2022-03-21T13:54:27.552669+0000","last_fullsized":"2022-03-21T13:54:27.552669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:48:39.601897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:30.895867+0000","last_change":"2022-03-21T13:54:27.178370+0000","last_active":"2022-03-21T13:54:30.895867+0000","last_peered":"2022-03-21T13:54:30.895867+0000","last_clean":"2022-03-21T13:54:30.895867+0000","last_became_active":"2022-03-21T13:54:27.178080+0000","last_became_peered":"2022-03-21T13:54:27.178080+0000","last_unstale":"2022-03-21T13:54:30.895867+0000","last_undegraded":"2022-03-21T13:54:30.895867+0000","last_fullsized":"2022-03-21T13:54:30.895867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:27:35.506923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563042+0000","last_change":"2022-03-21T13:54:27.557416+0000","last_active":"2022-03-21T13:54:27.563042+0000","last_peered":"2022-03-21T13:54:27.563042+0000","last_clean":"2022-03-21T13:54:27.563042+0000","last_became_active":"2022-03-21T13:54:27.557109+0000","last_became_peered":"2022-03-21T13:54:27.557109+0000","last_unstale":"2022-03-21T13:54:27.563042+0000","last_undegraded":"2022-03-21T13:54:27.563042+0000","last_fullsized":"2022-03-21T13:54:27.563042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:54:56.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.546643+0000","last_change":"2022-03-21T13:54:27.177642+0000","last_active":"2022-03-21T13:54:32.546643+0000","last_peered":"2022-03-21T13:54:32.546643+0000","last_clean":"2022-03-21T13:54:32.546643+0000","last_became_active":"2022-03-21T13:54:27.176415+0000","last_became_peered":"2022-03-21T13:54:27.176415+0000","last_unstale":"2022-03-21T13:54:32.546643+0000","last_undegraded":"2022-03-21T13:54:32.546643+0000","last_fullsized":"2022-03-21T13:54:32.546643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:07:20.332858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554536+0000","last_change":"2022-03-21T13:54:27.548038+0000","last_active":"2022-03-21T13:54:27.554536+0000","last_peered":"2022-03-21T13:54:27.554536+0000","last_clean":"2022-03-21T13:54:27.554536+0000","last_became_active":"2022-03-21T13:54:27.547693+0000","last_became_peered":"2022-03-21T13:54:27.547693+0000","last_unstale":"2022-03-21T13:54:27.554536+0000","last_undegraded":"2022-03-21T13:54:27.554536+0000","last_fullsized":"2022-03-21T13:54:27.554536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:20:34.987871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566096+0000","last_change":"2022-03-21T13:54:27.557329+0000","last_active":"2022-03-21T13:54:27.566096+0000","last_peered":"2022-03-21T13:54:27.566096+0000","last_clean":"2022-03-21T13:54:27.566096+0000","last_became_active":"2022-03-21T13:54:27.557050+0000","last_became_peered":"2022-03-21T13:54:27.557050+0000","last_unstale":"2022-03-21T13:54:27.566096+0000","last_undegraded":"2022-03-21T13:54:27.566096+0000","last_fullsized":"2022-03-21T13:54:27.566096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:29:21.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556375+0000","last_change":"2022-03-21T13:54:27.554172+0000","last_active":"2022-03-21T13:54:27.556375+0000","last_peered":"2022-03-21T13:54:27.556375+0000","last_clean":"2022-03-21T13:54:27.556375+0000","last_became_active":"2022-03-21T13:54:27.553846+0000","last_became_peered":"2022-03-21T13:54:27.553846+0000","last_unstale":"2022-03-21T13:54:27.556375+0000","last_undegraded":"2022-03-21T13:54:27.556375+0000","last_fullsized":"2022-03-21T13:54:27.556375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:26:44.119561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554578+0000","last_change":"2022-03-21T13:54:27.547824+0000","last_active":"2022-03-21T13:54:27.554578+0000","last_peered":"2022-03-21T13:54:27.554578+0000","last_clean":"2022-03-21T13:54:27.554578+0000","last_became_active":"2022-03-21T13:54:27.547518+0000","last_became_peered":"2022-03-21T13:54:27.547518+0000","last_unstale":"2022-03-21T13:54:27.554578+0000","last_undegraded":"2022-03-21T13:54:27.554578+0000","last_fullsized":"2022-03-21T13:54:27.554578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:51:03.595275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562755+0000","last_change":"2022-03-21T13:54:27.557697+0000","last_active":"2022-03-21T13:54:27.562755+0000","last_peered":"2022-03-21T13:54:27.562755+0000","last_clean":"2022-03-21T13:54:27.562755+0000","last_became_active":"2022-03-21T13:54:27.557422+0000","last_became_peered":"2022-03-21T13:54:27.557422+0000","last_unstale":"2022-03-21T13:54:27.562755+0000","last_undegraded":"2022-03-21T13:54:27.562755+0000","last_fullsized":"2022-03-21T13:54:27.562755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:19:10.850615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562316+0000","last_change":"2022-03-21T13:54:27.555304+0000","last_active":"2022-03-21T13:54:27.562316+0000","last_peered":"2022-03-21T13:54:27.562316+0000","last_clean":"2022-03-21T13:54:27.562316+0000","last_became_active":"2022-03-21T13:54:27.555046+0000","last_became_peered":"2022-03-21T13:54:27.555046+0000","last_unstale":"2022-03-21T13:54:27.562316+0000","last_undegraded":"2022-03-21T13:54:27.562316+0000","last_fullsized":"2022-03-21T13:54:27.562316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:20:53.409319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":58760,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9000,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362840,"statfs":{"total":96636764160,"available":96627548160,"internally_reserved":0,"allocated":294912,"data_stored":604872,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":74180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8972,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362868,"statfs":{"total":96636764160,"available":96627576832,"internally_reserved":0,"allocated":266240,"data_stored":603108,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8468,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363372,"statfs":{"total":96636764160,"available":96628092928,"internally_reserved":0,"allocated":208896,"data_stored":74746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":74180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8468,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363372,"statfs":{"total":96636764160,"available":96628092928,"internally_reserved":0,"allocated":208896,"data_stored":74270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":225280,"data_stored":75784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8408,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363432,"statfs":{"total":96636764160,"available":96628154368,"internally_reserved":0,"allocated":212992,"data_stored":74816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-03-21T13:54:37.682 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-03-21T13:54:37.829 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.828+0000 7f1b0283a700 1 Processor -- start 2022-03-21T13:54:37.830 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.828+0000 7f1b0283a700 1 -- start start 2022-03-21T13:54:37.832 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b0283a700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1afc0c5710 0x7f1afc1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:37.833 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b0283a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1afc0ca5a0 0x7f1afc0c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:37.833 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b0283a700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc0c5bb0 con 0x7f1afc0c63e0 2022-03-21T13:54:37.833 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b0283a700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc06dab0 con 0x7f1afc0c5710 2022-03-21T13:54:37.833 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b0283a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc158e00 con 0x7f1afc0ca5a0 2022-03-21T13:54:37.834 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b01037700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1afc0c5710 0x7f1afc1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:37.834 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b02039700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1afc0ca5a0 0x7f1afc0c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:37.834 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b01838700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f1afc0c63e0 0x7f1afc0c9e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:53046/0 (socket says 172.21.15.160:53046) 2022-03-21T13:54:37.834 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b01838700 1 -- 172.21.15.160:0/2734862545 learned_addr learned my addr 172.21.15.160:0/2734862545 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:37.835 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b01037700 1 -- 172.21.15.160:0/2734862545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1afc0ca5a0 msgr2=0x7f1afc0c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:37.835 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b01037700 1 --2- 172.21.15.160:0/2734862545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1afc0ca5a0 0x7f1afc0c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.835 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b01037700 1 -- 172.21.15.160:0/2734862545 >> v1:172.21.15.171:6789/0 conn(0x7f1afc0c63e0 legacy=0x7f1afc0c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.835 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b00836700 1 -- 172.21.15.160:0/2734862545 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250865216 0 0) 0x7f1afc0c5bb0 con 0x7f1afc0c63e0 2022-03-21T13:54:37.836 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.829+0000 7f1b01037700 1 -- 172.21.15.160:0/2734862545 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc154920 con 0x7f1afc0c5710 2022-03-21T13:54:37.836 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b02039700 1 --2- 172.21.15.160:0/2734862545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1afc0ca5a0 0x7f1afc0c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:37.836 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b01037700 1 --2- 172.21.15.160:0/2734862545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1afc0c5710 0x7f1afc1588c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009760 tx=0x7f1af0009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18632d204cc30790 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:37.836 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b00836700 1 -- 172.21.15.160:0/2734862545 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0011630 con 0x7f1afc0c5710 2022-03-21T13:54:37.836 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b00836700 1 -- 172.21.15.160:0/2734862545 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af0011790 con 0x7f1afc0c5710 2022-03-21T13:54:37.837 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b00836700 1 -- 172.21.15.160:0/2734862545 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0011b50 con 0x7f1afc0c5710 2022-03-21T13:54:37.837 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b0283a700 1 -- 172.21.15.160:0/2734862545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1afc0c5710 msgr2=0x7f1afc1588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.837 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b0283a700 1 --2- 172.21.15.160:0/2734862545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1afc0c5710 0x7f1afc1588c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009760 tx=0x7f1af0009060 comp rx=0 tx=0).stop 2022-03-21T13:54:37.837 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b0283a700 1 -- 172.21.15.160:0/2734862545 shutdown_connections 2022-03-21T13:54:37.837 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b0283a700 1 --2- 172.21.15.160:0/2734862545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1afc0ca5a0 0x7f1afc0c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.838 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b0283a700 1 --2- 172.21.15.160:0/2734862545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1afc0c5710 0x7f1afc1588c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.838 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b0283a700 1 -- 172.21.15.160:0/2734862545 >> 172.21.15.160:0/2734862545 conn(0x7f1afc0c78e0 msgr2=0x7f1afc0c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:37.838 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b0283a700 1 -- 172.21.15.160:0/2734862545 shutdown_connections 2022-03-21T13:54:37.838 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.830+0000 7f1b0283a700 1 -- 172.21.15.160:0/2734862545 wait complete. 2022-03-21T13:54:37.841 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.831+0000 7f1b0283a700 1 Processor -- start 2022-03-21T13:54:37.842 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.831+0000 7f1b0283a700 1 -- start start 2022-03-21T13:54:37.842 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.832+0000 7f1b0283a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1afc0c5710 0x7f1afc166130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:37.842 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.832+0000 7f1b0283a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1afc0c63e0 0x7f1afc166670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:37.842 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.832+0000 7f1b0283a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1afc0ca5a0 0x7f1afc14fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:37.843 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.832+0000 7f1b0283a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc06ab90 con 0x7f1afc0c63e0 2022-03-21T13:54:37.843 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.832+0000 7f1b0283a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc165070 con 0x7f1afc0c5710 2022-03-21T13:54:37.843 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.832+0000 7f1b0283a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc06b0e0 con 0x7f1afc0ca5a0 2022-03-21T13:54:37.843 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.832+0000 7f1b01037700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1afc0c63e0 0x7f1afc166670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:37.843 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.832+0000 7f1b01037700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1afc0c63e0 0x7f1afc166670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56812/0 (socket says 172.21.15.160:56812) 2022-03-21T13:54:37.844 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.832+0000 7f1b01037700 1 -- 172.21.15.160:0/2543944152 learned_addr learned my addr 172.21.15.160:0/2543944152 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:37.844 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.832+0000 7f1b01838700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1afc0c5710 0x7f1afc166130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:37.844 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1b02039700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1afc0ca5a0 0x7f1afc14fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:37.844 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1b01037700 1 -- 172.21.15.160:0/2543944152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1afc0ca5a0 msgr2=0x7f1afc14fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.845 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1b01037700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1afc0ca5a0 0x7f1afc14fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.845 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1b01037700 1 -- 172.21.15.160:0/2543944152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1afc0c5710 msgr2=0x7f1afc166130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:37.845 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1b01037700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1afc0c5710 0x7f1afc166130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:37.845 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1b01037700 1 -- 172.21.15.160:0/2543944152 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40092a0 con 0x7f1afc0c63e0 2022-03-21T13:54:37.845 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1b01838700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1afc0c5710 0x7f1afc166130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:37.846 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1b01037700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1afc0c63e0 0x7f1afc166670 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009e00 tx=0x7f1af0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:37.846 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1af9ffb700 1 -- 172.21.15.160:0/2543944152 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0000bf0 con 0x7f1afc0c63e0 2022-03-21T13:54:37.846 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1af9ffb700 1 -- 172.21.15.160:0/2543944152 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af0011900 con 0x7f1afc0c63e0 2022-03-21T13:54:37.846 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1b0283a700 1 -- 172.21.15.160:0/2543944152 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af00092a0 con 0x7f1afc0c63e0 2022-03-21T13:54:37.847 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1af9ffb700 1 -- 172.21.15.160:0/2543944152 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0025420 con 0x7f1afc0c63e0 2022-03-21T13:54:37.847 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.833+0000 7f1b0283a700 1 -- 172.21.15.160:0/2543944152 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc06a1f0 con 0x7f1afc0c63e0 2022-03-21T13:54:37.847 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.834+0000 7f1b0283a700 1 -- 172.21.15.160:0/2543944152 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1afc069450 con 0x7f1afc0c63e0 2022-03-21T13:54:37.847 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.834+0000 7f1af9ffb700 1 -- 172.21.15.160:0/2543944152 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f1af002c030 con 0x7f1afc0c63e0 2022-03-21T13:54:37.847 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.835+0000 7f1af9ffb700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1adc063ce0 0x7f1adc066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:37.848 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.835+0000 7f1af9ffb700 1 -- 172.21.15.160:0/2543944152 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1af0081e10 con 0x7f1afc0c63e0 2022-03-21T13:54:37.848 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.835+0000 7f1b01838700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1adc063ce0 0x7f1adc066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:37.848 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.835+0000 7f1b01838700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1adc063ce0 0x7f1adc066190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1aec007450 tx=0x7f1aec007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:37.848 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:37.839+0000 7f1af9ffb700 1 -- 172.21.15.160:0/2543944152 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f1af0050aa0 con 0x7f1afc0c63e0 2022-03-21T13:54:38.006 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.004+0000 7f1b0283a700 1 -- 172.21.15.160:0/2543944152 --> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1afc04b760 con 0x7f1adc063ce0 2022-03-21T13:54:38.013 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.012+0000 7f1af9ffb700 1 -- 172.21.15.160:0/2543944152 <== mgr.4104 v2:172.21.15.160:6832/25205 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284962 (secure 0 0 0) 0x7f1afc04b760 con 0x7f1adc063ce0 2022-03-21T13:54:38.017 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:38.020 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 -- 172.21.15.160:0/2543944152 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1adc063ce0 msgr2=0x7f1adc066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:38.020 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1adc063ce0 0x7f1adc066190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1aec007450 tx=0x7f1aec007f10 comp rx=0 tx=0).stop 2022-03-21T13:54:38.020 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 -- 172.21.15.160:0/2543944152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1afc0c63e0 msgr2=0x7f1afc166670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:38.021 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1afc0c63e0 0x7f1afc166670 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009e00 tx=0x7f1af0017000 comp rx=0 tx=0).stop 2022-03-21T13:54:38.021 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 -- 172.21.15.160:0/2543944152 shutdown_connections 2022-03-21T13:54:38.021 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f1adc063ce0 0x7f1adc066190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.021 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1afc0ca5a0 0x7f1afc14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.022 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1afc0c5710 0x7f1afc166130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.022 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 --2- 172.21.15.160:0/2543944152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1afc0c63e0 0x7f1afc166670 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.022 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 -- 172.21.15.160:0/2543944152 >> 172.21.15.160:0/2543944152 conn(0x7f1afc0c78e0 msgr2=0x7f1afc0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:38.022 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 -- 172.21.15.160:0/2543944152 shutdown_connections 2022-03-21T13:54:38.023 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.015+0000 7f1b0283a700 1 -- 172.21.15.160:0/2543944152 wait complete. 2022-03-21T13:54:38.023 INFO:teuthology.orchestra.run.smithi160.stderr:dumped all 2022-03-21T13:54:38.029 INFO:teuthology.orchestra.run.smithi160.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2022-03-21T13:54:37.460299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68600,"kb_used_data":1784,"kb_used_omap":0,"kb_used_meta":66752,"kb_avail":754906120,"statfs":{"total":773094113280,"available":773023866880,"internally_reserved":0,"allocated":1826816,"data_stored":1655956,"data_compressed":58760,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":68354048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.923330"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562599+0000","last_change":"2022-03-21T13:54:27.560800+0000","last_active":"2022-03-21T13:54:27.562599+0000","last_peered":"2022-03-21T13:54:27.562599+0000","last_clean":"2022-03-21T13:54:27.562599+0000","last_became_active":"2022-03-21T13:54:27.560524+0000","last_became_peered":"2022-03-21T13:54:27.560524+0000","last_unstale":"2022-03-21T13:54:27.562599+0000","last_undegraded":"2022-03-21T13:54:27.562599+0000","last_fullsized":"2022-03-21T13:54:27.562599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:29:18.469060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.550598+0000","last_change":"2022-03-21T13:54:27.546054+0000","last_active":"2022-03-21T13:54:27.550598+0000","last_peered":"2022-03-21T13:54:27.550598+0000","last_clean":"2022-03-21T13:54:27.550598+0000","last_became_active":"2022-03-21T13:54:27.545740+0000","last_became_peered":"2022-03-21T13:54:27.545740+0000","last_unstale":"2022-03-21T13:54:27.550598+0000","last_undegraded":"2022-03-21T13:54:27.550598+0000","last_fullsized":"2022-03-21T13:54:27.550598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:26:02.461346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561382+0000","last_change":"2022-03-21T13:54:27.558255+0000","last_active":"2022-03-21T13:54:27.561382+0000","last_peered":"2022-03-21T13:54:27.561382+0000","last_clean":"2022-03-21T13:54:27.561382+0000","last_became_active":"2022-03-21T13:54:27.558022+0000","last_became_peered":"2022-03-21T13:54:27.558022+0000","last_unstale":"2022-03-21T13:54:27.561382+0000","last_undegraded":"2022-03-21T13:54:27.561382+0000","last_fullsized":"2022-03-21T13:54:27.561382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:13:18.709698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566124+0000","last_change":"2022-03-21T13:54:27.557489+0000","last_active":"2022-03-21T13:54:27.566124+0000","last_peered":"2022-03-21T13:54:27.566124+0000","last_clean":"2022-03-21T13:54:27.566124+0000","last_became_active":"2022-03-21T13:54:27.557158+0000","last_became_peered":"2022-03-21T13:54:27.557158+0000","last_unstale":"2022-03-21T13:54:27.566124+0000","last_undegraded":"2022-03-21T13:54:27.566124+0000","last_fullsized":"2022-03-21T13:54:27.566124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:40:54.983646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.565666+0000","last_change":"2022-03-21T13:54:27.564403+0000","last_active":"2022-03-21T13:54:27.565666+0000","last_peered":"2022-03-21T13:54:27.565666+0000","last_clean":"2022-03-21T13:54:27.565666+0000","last_became_active":"2022-03-21T13:54:27.564206+0000","last_became_peered":"2022-03-21T13:54:27.564206+0000","last_unstale":"2022-03-21T13:54:27.565666+0000","last_undegraded":"2022-03-21T13:54:27.565666+0000","last_fullsized":"2022-03-21T13:54:27.565666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:59:14.326123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561303+0000","last_change":"2022-03-21T13:54:27.557180+0000","last_active":"2022-03-21T13:54:27.561303+0000","last_peered":"2022-03-21T13:54:27.561303+0000","last_clean":"2022-03-21T13:54:27.561303+0000","last_became_active":"2022-03-21T13:54:27.556920+0000","last_became_peered":"2022-03-21T13:54:27.556920+0000","last_unstale":"2022-03-21T13:54:27.561303+0000","last_undegraded":"2022-03-21T13:54:27.561303+0000","last_fullsized":"2022-03-21T13:54:27.561303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:08:18.086954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566644+0000","last_change":"2022-03-21T13:54:27.565259+0000","last_active":"2022-03-21T13:54:27.566644+0000","last_peered":"2022-03-21T13:54:27.566644+0000","last_clean":"2022-03-21T13:54:27.566644+0000","last_became_active":"2022-03-21T13:54:27.564920+0000","last_became_peered":"2022-03-21T13:54:27.564920+0000","last_unstale":"2022-03-21T13:54:27.566644+0000","last_undegraded":"2022-03-21T13:54:27.566644+0000","last_fullsized":"2022-03-21T13:54:27.566644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:32:42.928977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556183+0000","last_change":"2022-03-21T13:54:27.553677+0000","last_active":"2022-03-21T13:54:27.556183+0000","last_peered":"2022-03-21T13:54:27.556183+0000","last_clean":"2022-03-21T13:54:27.556183+0000","last_became_active":"2022-03-21T13:54:27.553385+0000","last_became_peered":"2022-03-21T13:54:27.553385+0000","last_unstale":"2022-03-21T13:54:27.556183+0000","last_undegraded":"2022-03-21T13:54:27.556183+0000","last_fullsized":"2022-03-21T13:54:27.556183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:11:07.645677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564122+0000","last_change":"2022-03-21T13:54:27.558348+0000","last_active":"2022-03-21T13:54:27.564122+0000","last_peered":"2022-03-21T13:54:27.564122+0000","last_clean":"2022-03-21T13:54:27.564122+0000","last_became_active":"2022-03-21T13:54:27.557809+0000","last_became_peered":"2022-03-21T13:54:27.557809+0000","last_unstale":"2022-03-21T13:54:27.564122+0000","last_undegraded":"2022-03-21T13:54:27.564122+0000","last_fullsized":"2022-03-21T13:54:27.564122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:46:38.130496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561257+0000","last_change":"2022-03-21T13:54:27.557849+0000","last_active":"2022-03-21T13:54:27.561257+0000","last_peered":"2022-03-21T13:54:27.561257+0000","last_clean":"2022-03-21T13:54:27.561257+0000","last_became_active":"2022-03-21T13:54:27.557598+0000","last_became_peered":"2022-03-21T13:54:27.557598+0000","last_unstale":"2022-03-21T13:54:27.561257+0000","last_undegraded":"2022-03-21T13:54:27.561257+0000","last_fullsized":"2022-03-21T13:54:27.561257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:02:12.450734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552732+0000","last_change":"2022-03-21T13:54:27.546503+0000","last_active":"2022-03-21T13:54:27.552732+0000","last_peered":"2022-03-21T13:54:27.552732+0000","last_clean":"2022-03-21T13:54:27.552732+0000","last_became_active":"2022-03-21T13:54:27.546206+0000","last_became_peered":"2022-03-21T13:54:27.546206+0000","last_unstale":"2022-03-21T13:54:27.552732+0000","last_undegraded":"2022-03-21T13:54:27.552732+0000","last_fullsized":"2022-03-21T13:54:27.552732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:30:57.355670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561846+0000","last_change":"2022-03-21T13:54:27.556507+0000","last_active":"2022-03-21T13:54:27.561846+0000","last_peered":"2022-03-21T13:54:27.561846+0000","last_clean":"2022-03-21T13:54:27.561846+0000","last_became_active":"2022-03-21T13:54:27.556230+0000","last_became_peered":"2022-03-21T13:54:27.556230+0000","last_unstale":"2022-03-21T13:54:27.561846+0000","last_undegraded":"2022-03-21T13:54:27.561846+0000","last_fullsized":"2022-03-21T13:54:27.561846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:34:35.624406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562378+0000","last_change":"2022-03-21T13:54:27.559880+0000","last_active":"2022-03-21T13:54:27.562378+0000","last_peered":"2022-03-21T13:54:27.562378+0000","last_clean":"2022-03-21T13:54:27.562378+0000","last_became_active":"2022-03-21T13:54:27.559587+0000","last_became_peered":"2022-03-21T13:54:27.559587+0000","last_unstale":"2022-03-21T13:54:27.562378+0000","last_undegraded":"2022-03-21T13:54:27.562378+0000","last_fullsized":"2022-03-21T13:54:27.562378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:25:15.705881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561513+0000","last_change":"2022-03-21T13:54:27.558473+0000","last_active":"2022-03-21T13:54:27.561513+0000","last_peered":"2022-03-21T13:54:27.561513+0000","last_clean":"2022-03-21T13:54:27.561513+0000","last_became_active":"2022-03-21T13:54:27.557800+0000","last_became_peered":"2022-03-21T13:54:27.557800+0000","last_unstale":"2022-03-21T13:54:27.561513+0000","last_undegraded":"2022-03-21T13:54:27.561513+0000","last_fullsized":"2022-03-21T13:54:27.561513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:43:47.336190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566631+0000","last_change":"2022-03-21T13:54:27.565260+0000","last_active":"2022-03-21T13:54:27.566631+0000","last_peered":"2022-03-21T13:54:27.566631+0000","last_clean":"2022-03-21T13:54:27.566631+0000","last_became_active":"2022-03-21T13:54:27.564955+0000","last_became_peered":"2022-03-21T13:54:27.564955+0000","last_unstale":"2022-03-21T13:54:27.566631+0000","last_undegraded":"2022-03-21T13:54:27.566631+0000","last_fullsized":"2022-03-21T13:54:27.566631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T13:54:36.332945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561411+0000","last_change":"2022-03-21T13:54:27.558826+0000","last_active":"2022-03-21T13:54:27.561411+0000","last_peered":"2022-03-21T13:54:27.561411+0000","last_clean":"2022-03-21T13:54:27.561411+0000","last_became_active":"2022-03-21T13:54:27.558001+0000","last_became_peered":"2022-03-21T13:54:27.558001+0000","last_unstale":"2022-03-21T13:54:27.561411+0000","last_undegraded":"2022-03-21T13:54:27.561411+0000","last_fullsized":"2022-03-21T13:54:27.561411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:09:43.452276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561416+0000","last_change":"2022-03-21T13:54:27.556666+0000","last_active":"2022-03-21T13:54:27.561416+0000","last_peered":"2022-03-21T13:54:27.561416+0000","last_clean":"2022-03-21T13:54:27.561416+0000","last_became_active":"2022-03-21T13:54:27.556355+0000","last_became_peered":"2022-03-21T13:54:27.556355+0000","last_unstale":"2022-03-21T13:54:27.561416+0000","last_undegraded":"2022-03-21T13:54:27.561416+0000","last_fullsized":"2022-03-21T13:54:27.561416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:50:08.704449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561401+0000","last_change":"2022-03-21T13:54:27.558635+0000","last_active":"2022-03-21T13:54:27.561401+0000","last_peered":"2022-03-21T13:54:27.561401+0000","last_clean":"2022-03-21T13:54:27.561401+0000","last_became_active":"2022-03-21T13:54:27.558320+0000","last_became_peered":"2022-03-21T13:54:27.558320+0000","last_unstale":"2022-03-21T13:54:27.561401+0000","last_undegraded":"2022-03-21T13:54:27.561401+0000","last_fullsized":"2022-03-21T13:54:27.561401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:14:17.971078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562412+0000","last_change":"2022-03-21T13:54:27.557412+0000","last_active":"2022-03-21T13:54:27.562412+0000","last_peered":"2022-03-21T13:54:27.562412+0000","last_clean":"2022-03-21T13:54:27.562412+0000","last_became_active":"2022-03-21T13:54:27.557140+0000","last_became_peered":"2022-03-21T13:54:27.557140+0000","last_unstale":"2022-03-21T13:54:27.562412+0000","last_undegraded":"2022-03-21T13:54:27.562412+0000","last_fullsized":"2022-03-21T13:54:27.562412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:14:32.888607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556264+0000","last_change":"2022-03-21T13:54:27.553441+0000","last_active":"2022-03-21T13:54:27.556264+0000","last_peered":"2022-03-21T13:54:27.556264+0000","last_clean":"2022-03-21T13:54:27.556264+0000","last_became_active":"2022-03-21T13:54:27.553027+0000","last_became_peered":"2022-03-21T13:54:27.553027+0000","last_unstale":"2022-03-21T13:54:27.556264+0000","last_undegraded":"2022-03-21T13:54:27.556264+0000","last_fullsized":"2022-03-21T13:54:27.556264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:18:30.624463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566609+0000","last_change":"2022-03-21T13:54:27.563794+0000","last_active":"2022-03-21T13:54:27.566609+0000","last_peered":"2022-03-21T13:54:27.566609+0000","last_clean":"2022-03-21T13:54:27.566609+0000","last_became_active":"2022-03-21T13:54:27.563545+0000","last_became_peered":"2022-03-21T13:54:27.563545+0000","last_unstale":"2022-03-21T13:54:27.566609+0000","last_undegraded":"2022-03-21T13:54:27.566609+0000","last_fullsized":"2022-03-21T13:54:27.566609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:50:55.275326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561275+0000","last_change":"2022-03-21T13:54:27.553387+0000","last_active":"2022-03-21T13:54:27.561275+0000","last_peered":"2022-03-21T13:54:27.561275+0000","last_clean":"2022-03-21T13:54:27.561275+0000","last_became_active":"2022-03-21T13:54:27.553153+0000","last_became_peered":"2022-03-21T13:54:27.553153+0000","last_unstale":"2022-03-21T13:54:27.561275+0000","last_undegraded":"2022-03-21T13:54:27.561275+0000","last_fullsized":"2022-03-21T13:54:27.561275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:50:23.006803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.565877+0000","last_change":"2022-03-21T13:54:27.563751+0000","last_active":"2022-03-21T13:54:27.565877+0000","last_peered":"2022-03-21T13:54:27.565877+0000","last_clean":"2022-03-21T13:54:27.565877+0000","last_became_active":"2022-03-21T13:54:27.563500+0000","last_became_peered":"2022-03-21T13:54:27.563500+0000","last_unstale":"2022-03-21T13:54:27.565877+0000","last_undegraded":"2022-03-21T13:54:27.565877+0000","last_fullsized":"2022-03-21T13:54:27.565877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:56:25.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566301+0000","last_change":"2022-03-21T13:54:27.558999+0000","last_active":"2022-03-21T13:54:27.566301+0000","last_peered":"2022-03-21T13:54:27.566301+0000","last_clean":"2022-03-21T13:54:27.566301+0000","last_became_active":"2022-03-21T13:54:27.558681+0000","last_became_peered":"2022-03-21T13:54:27.558681+0000","last_unstale":"2022-03-21T13:54:27.566301+0000","last_undegraded":"2022-03-21T13:54:27.566301+0000","last_fullsized":"2022-03-21T13:54:27.566301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:42:26.014896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552966+0000","last_change":"2022-03-21T13:54:27.550096+0000","last_active":"2022-03-21T13:54:27.552966+0000","last_peered":"2022-03-21T13:54:27.552966+0000","last_clean":"2022-03-21T13:54:27.552966+0000","last_became_active":"2022-03-21T13:54:27.549821+0000","last_became_peered":"2022-03-21T13:54:27.549821+0000","last_unstale":"2022-03-21T13:54:27.552966+0000","last_undegraded":"2022-03-21T13:54:27.552966+0000","last_fullsized":"2022-03-21T13:54:27.552966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:32:24.498709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563579+0000","last_change":"2022-03-21T13:54:27.561032+0000","last_active":"2022-03-21T13:54:27.563579+0000","last_peered":"2022-03-21T13:54:27.563579+0000","last_clean":"2022-03-21T13:54:27.563579+0000","last_became_active":"2022-03-21T13:54:27.560494+0000","last_became_peered":"2022-03-21T13:54:27.560494+0000","last_unstale":"2022-03-21T13:54:27.563579+0000","last_undegraded":"2022-03-21T13:54:27.563579+0000","last_fullsized":"2022-03-21T13:54:27.563579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:25:56.396980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561291+0000","last_change":"2022-03-21T13:54:27.558917+0000","last_active":"2022-03-21T13:54:27.561291+0000","last_peered":"2022-03-21T13:54:27.561291+0000","last_clean":"2022-03-21T13:54:27.561291+0000","last_became_active":"2022-03-21T13:54:27.556966+0000","last_became_peered":"2022-03-21T13:54:27.556966+0000","last_unstale":"2022-03-21T13:54:27.561291+0000","last_undegraded":"2022-03-21T13:54:27.561291+0000","last_fullsized":"2022-03-21T13:54:27.561291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:43:43.072254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:29.751955+0000","last_change":"2022-03-21T13:54:27.180549+0000","last_active":"2022-03-21T13:54:29.751955+0000","last_peered":"2022-03-21T13:54:29.751955+0000","last_clean":"2022-03-21T13:54:29.751955+0000","last_became_active":"2022-03-21T13:54:27.178977+0000","last_became_peered":"2022-03-21T13:54:27.178977+0000","last_unstale":"2022-03-21T13:54:29.751955+0000","last_undegraded":"2022-03-21T13:54:29.751955+0000","last_fullsized":"2022-03-21T13:54:29.751955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:11:42.262563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553642+0000","last_change":"2022-03-21T13:54:27.546371+0000","last_active":"2022-03-21T13:54:27.553642+0000","last_peered":"2022-03-21T13:54:27.553642+0000","last_clean":"2022-03-21T13:54:27.553642+0000","last_became_active":"2022-03-21T13:54:27.546107+0000","last_became_peered":"2022-03-21T13:54:27.546107+0000","last_unstale":"2022-03-21T13:54:27.553642+0000","last_undegraded":"2022-03-21T13:54:27.553642+0000","last_fullsized":"2022-03-21T13:54:27.553642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:03:31.464752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546952+0000","last_change":"2022-03-21T13:54:27.184281+0000","last_active":"2022-03-21T13:54:27.546952+0000","last_peered":"2022-03-21T13:54:27.546952+0000","last_clean":"2022-03-21T13:54:27.546952+0000","last_became_active":"2022-03-21T13:54:27.183982+0000","last_became_peered":"2022-03-21T13:54:27.183982+0000","last_unstale":"2022-03-21T13:54:27.546952+0000","last_undegraded":"2022-03-21T13:54:27.546952+0000","last_fullsized":"2022-03-21T13:54:27.546952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:05:10.462607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564746+0000","last_change":"2022-03-21T13:54:27.561606+0000","last_active":"2022-03-21T13:54:27.564746+0000","last_peered":"2022-03-21T13:54:27.564746+0000","last_clean":"2022-03-21T13:54:27.564746+0000","last_became_active":"2022-03-21T13:54:27.557656+0000","last_became_peered":"2022-03-21T13:54:27.557656+0000","last_unstale":"2022-03-21T13:54:27.564746+0000","last_undegraded":"2022-03-21T13:54:27.564746+0000","last_fullsized":"2022-03-21T13:54:27.564746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:18:31.529342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538741+0000","last_change":"2022-03-21T13:54:27.181800+0000","last_active":"2022-03-21T13:54:27.538741+0000","last_peered":"2022-03-21T13:54:27.538741+0000","last_clean":"2022-03-21T13:54:27.538741+0000","last_became_active":"2022-03-21T13:54:27.181378+0000","last_became_peered":"2022-03-21T13:54:27.181378+0000","last_unstale":"2022-03-21T13:54:27.538741+0000","last_undegraded":"2022-03-21T13:54:27.538741+0000","last_fullsized":"2022-03-21T13:54:27.538741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T13:59:13.837451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553680+0000","last_change":"2022-03-21T13:54:27.547987+0000","last_active":"2022-03-21T13:54:27.553680+0000","last_peered":"2022-03-21T13:54:27.553680+0000","last_clean":"2022-03-21T13:54:27.553680+0000","last_became_active":"2022-03-21T13:54:27.547719+0000","last_became_peered":"2022-03-21T13:54:27.547719+0000","last_unstale":"2022-03-21T13:54:27.553680+0000","last_undegraded":"2022-03-21T13:54:27.553680+0000","last_fullsized":"2022-03-21T13:54:27.553680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:20:42.860191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.548892+0000","last_change":"2022-03-21T13:54:27.177649+0000","last_active":"2022-03-21T13:54:27.548892+0000","last_peered":"2022-03-21T13:54:27.548892+0000","last_clean":"2022-03-21T13:54:27.548892+0000","last_became_active":"2022-03-21T13:54:27.176925+0000","last_became_peered":"2022-03-21T13:54:27.176925+0000","last_unstale":"2022-03-21T13:54:27.548892+0000","last_undegraded":"2022-03-21T13:54:27.548892+0000","last_fullsized":"2022-03-21T13:54:27.548892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:05:31.974802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.555060+0000","last_change":"2022-03-21T13:54:27.553129+0000","last_active":"2022-03-21T13:54:27.555060+0000","last_peered":"2022-03-21T13:54:27.555060+0000","last_clean":"2022-03-21T13:54:27.555060+0000","last_became_active":"2022-03-21T13:54:27.552857+0000","last_became_peered":"2022-03-21T13:54:27.552857+0000","last_unstale":"2022-03-21T13:54:27.555060+0000","last_undegraded":"2022-03-21T13:54:27.555060+0000","last_fullsized":"2022-03-21T13:54:27.555060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:49:43.458618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.540230+0000","last_change":"2022-03-21T13:54:27.176726+0000","last_active":"2022-03-21T13:54:27.540230+0000","last_peered":"2022-03-21T13:54:27.540230+0000","last_clean":"2022-03-21T13:54:27.540230+0000","last_became_active":"2022-03-21T13:54:27.176464+0000","last_became_peered":"2022-03-21T13:54:27.176464+0000","last_unstale":"2022-03-21T13:54:27.540230+0000","last_undegraded":"2022-03-21T13:54:27.540230+0000","last_fullsized":"2022-03-21T13:54:27.540230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:01:07.573227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.557296+0000","last_change":"2022-03-21T13:54:27.555953+0000","last_active":"2022-03-21T13:54:27.557296+0000","last_peered":"2022-03-21T13:54:27.557296+0000","last_clean":"2022-03-21T13:54:27.557296+0000","last_became_active":"2022-03-21T13:54:27.555697+0000","last_became_peered":"2022-03-21T13:54:27.555697+0000","last_unstale":"2022-03-21T13:54:27.557296+0000","last_undegraded":"2022-03-21T13:54:27.557296+0000","last_fullsized":"2022-03-21T13:54:27.557296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T19:04:28.623659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.545472+0000","last_change":"2022-03-21T13:54:27.181859+0000","last_active":"2022-03-21T13:54:32.545472+0000","last_peered":"2022-03-21T13:54:32.545472+0000","last_clean":"2022-03-21T13:54:32.545472+0000","last_became_active":"2022-03-21T13:54:27.181629+0000","last_became_peered":"2022-03-21T13:54:27.181629+0000","last_unstale":"2022-03-21T13:54:32.545472+0000","last_undegraded":"2022-03-21T13:54:32.545472+0000","last_fullsized":"2022-03-21T13:54:32.545472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:24:23.689696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.553010+0000","last_change":"2022-03-21T13:54:27.549413+0000","last_active":"2022-03-21T13:54:27.553010+0000","last_peered":"2022-03-21T13:54:27.553010+0000","last_clean":"2022-03-21T13:54:27.553010+0000","last_became_active":"2022-03-21T13:54:27.549162+0000","last_became_peered":"2022-03-21T13:54:27.549162+0000","last_unstale":"2022-03-21T13:54:27.553010+0000","last_undegraded":"2022-03-21T13:54:27.553010+0000","last_fullsized":"2022-03-21T13:54:27.553010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:06:56.454596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547977+0000","last_change":"2022-03-21T13:54:27.181484+0000","last_active":"2022-03-21T13:54:32.547977+0000","last_peered":"2022-03-21T13:54:32.547977+0000","last_clean":"2022-03-21T13:54:32.547977+0000","last_became_active":"2022-03-21T13:54:27.181191+0000","last_became_peered":"2022-03-21T13:54:27.181191+0000","last_unstale":"2022-03-21T13:54:32.547977+0000","last_undegraded":"2022-03-21T13:54:32.547977+0000","last_fullsized":"2022-03-21T13:54:32.547977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:10:19.939317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554603+0000","last_change":"2022-03-21T13:54:27.547927+0000","last_active":"2022-03-21T13:54:27.554603+0000","last_peered":"2022-03-21T13:54:27.554603+0000","last_clean":"2022-03-21T13:54:27.554603+0000","last_became_active":"2022-03-21T13:54:27.547605+0000","last_became_peered":"2022-03-21T13:54:27.547605+0000","last_unstale":"2022-03-21T13:54:27.554603+0000","last_undegraded":"2022-03-21T13:54:27.554603+0000","last_fullsized":"2022-03-21T13:54:27.554603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:57:24.920256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547299+0000","last_change":"2022-03-21T13:54:27.183437+0000","last_active":"2022-03-21T13:54:32.547299+0000","last_peered":"2022-03-21T13:54:32.547299+0000","last_clean":"2022-03-21T13:54:32.547299+0000","last_became_active":"2022-03-21T13:54:27.183118+0000","last_became_peered":"2022-03-21T13:54:27.183118+0000","last_unstale":"2022-03-21T13:54:32.547299+0000","last_undegraded":"2022-03-21T13:54:32.547299+0000","last_fullsized":"2022-03-21T13:54:32.547299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:46:16.301549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556401+0000","last_change":"2022-03-21T13:54:27.553692+0000","last_active":"2022-03-21T13:54:27.556401+0000","last_peered":"2022-03-21T13:54:27.556401+0000","last_clean":"2022-03-21T13:54:27.556401+0000","last_became_active":"2022-03-21T13:54:27.553419+0000","last_became_peered":"2022-03-21T13:54:27.553419+0000","last_unstale":"2022-03-21T13:54:27.556401+0000","last_undegraded":"2022-03-21T13:54:27.556401+0000","last_fullsized":"2022-03-21T13:54:27.556401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:47:02.533721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.541256+0000","last_change":"2022-03-21T13:54:27.179452+0000","last_active":"2022-03-21T13:54:27.541256+0000","last_peered":"2022-03-21T13:54:27.541256+0000","last_clean":"2022-03-21T13:54:27.541256+0000","last_became_active":"2022-03-21T13:54:27.177655+0000","last_became_peered":"2022-03-21T13:54:27.177655+0000","last_unstale":"2022-03-21T13:54:27.541256+0000","last_undegraded":"2022-03-21T13:54:27.541256+0000","last_fullsized":"2022-03-21T13:54:27.541256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:42:43.049495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561270+0000","last_change":"2022-03-21T13:54:27.557989+0000","last_active":"2022-03-21T13:54:27.561270+0000","last_peered":"2022-03-21T13:54:27.561270+0000","last_clean":"2022-03-21T13:54:27.561270+0000","last_became_active":"2022-03-21T13:54:27.557346+0000","last_became_peered":"2022-03-21T13:54:27.557346+0000","last_unstale":"2022-03-21T13:54:27.561270+0000","last_undegraded":"2022-03-21T13:54:27.561270+0000","last_fullsized":"2022-03-21T13:54:27.561270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:54:09.949225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552575+0000","last_change":"2022-03-21T13:54:27.177423+0000","last_active":"2022-03-21T13:54:27.552575+0000","last_peered":"2022-03-21T13:54:27.552575+0000","last_clean":"2022-03-21T13:54:27.552575+0000","last_became_active":"2022-03-21T13:54:27.177050+0000","last_became_peered":"2022-03-21T13:54:27.177050+0000","last_unstale":"2022-03-21T13:54:27.552575+0000","last_undegraded":"2022-03-21T13:54:27.552575+0000","last_fullsized":"2022-03-21T13:54:27.552575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:03:05.301157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564724+0000","last_change":"2022-03-21T13:54:27.557999+0000","last_active":"2022-03-21T13:54:27.564724+0000","last_peered":"2022-03-21T13:54:27.564724+0000","last_clean":"2022-03-21T13:54:27.564724+0000","last_became_active":"2022-03-21T13:54:27.557001+0000","last_became_peered":"2022-03-21T13:54:27.557001+0000","last_unstale":"2022-03-21T13:54:27.564724+0000","last_undegraded":"2022-03-21T13:54:27.564724+0000","last_fullsized":"2022-03-21T13:54:27.564724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:44:28.857826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547325+0000","last_change":"2022-03-21T13:54:27.184135+0000","last_active":"2022-03-21T13:54:32.547325+0000","last_peered":"2022-03-21T13:54:32.547325+0000","last_clean":"2022-03-21T13:54:32.547325+0000","last_became_active":"2022-03-21T13:54:27.183892+0000","last_became_peered":"2022-03-21T13:54:27.183892+0000","last_unstale":"2022-03-21T13:54:32.547325+0000","last_undegraded":"2022-03-21T13:54:32.547325+0000","last_fullsized":"2022-03-21T13:54:32.547325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:44:30.017340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564841+0000","last_change":"2022-03-21T13:54:27.559857+0000","last_active":"2022-03-21T13:54:27.564841+0000","last_peered":"2022-03-21T13:54:27.564841+0000","last_clean":"2022-03-21T13:54:27.564841+0000","last_became_active":"2022-03-21T13:54:27.559336+0000","last_became_peered":"2022-03-21T13:54:27.559336+0000","last_unstale":"2022-03-21T13:54:27.564841+0000","last_undegraded":"2022-03-21T13:54:27.564841+0000","last_fullsized":"2022-03-21T13:54:27.564841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:43:12.014350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:30.900451+0000","last_change":"2022-03-21T13:54:27.178818+0000","last_active":"2022-03-21T13:54:30.900451+0000","last_peered":"2022-03-21T13:54:30.900451+0000","last_clean":"2022-03-21T13:54:30.900451+0000","last_became_active":"2022-03-21T13:54:27.178542+0000","last_became_peered":"2022-03-21T13:54:27.178542+0000","last_unstale":"2022-03-21T13:54:30.900451+0000","last_undegraded":"2022-03-21T13:54:30.900451+0000","last_fullsized":"2022-03-21T13:54:30.900451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:45:39.568015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.560603+0000","last_change":"2022-03-21T13:54:27.555377+0000","last_active":"2022-03-21T13:54:27.560603+0000","last_peered":"2022-03-21T13:54:27.560603+0000","last_clean":"2022-03-21T13:54:27.560603+0000","last_became_active":"2022-03-21T13:54:27.555080+0000","last_became_peered":"2022-03-21T13:54:27.555080+0000","last_unstale":"2022-03-21T13:54:27.560603+0000","last_undegraded":"2022-03-21T13:54:27.560603+0000","last_fullsized":"2022-03-21T13:54:27.560603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:16:31.684909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547235+0000","last_change":"2022-03-21T13:54:27.175755+0000","last_active":"2022-03-21T13:54:32.547235+0000","last_peered":"2022-03-21T13:54:32.547235+0000","last_clean":"2022-03-21T13:54:32.547235+0000","last_became_active":"2022-03-21T13:54:27.175442+0000","last_became_peered":"2022-03-21T13:54:27.175442+0000","last_unstale":"2022-03-21T13:54:32.547235+0000","last_undegraded":"2022-03-21T13:54:32.547235+0000","last_fullsized":"2022-03-21T13:54:32.547235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:21:41.935690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559410+0000","last_change":"2022-03-21T13:54:27.555167+0000","last_active":"2022-03-21T13:54:27.559410+0000","last_peered":"2022-03-21T13:54:27.559410+0000","last_clean":"2022-03-21T13:54:27.559410+0000","last_became_active":"2022-03-21T13:54:27.554856+0000","last_became_peered":"2022-03-21T13:54:27.554856+0000","last_unstale":"2022-03-21T13:54:27.559410+0000","last_undegraded":"2022-03-21T13:54:27.559410+0000","last_fullsized":"2022-03-21T13:54:27.559410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:57:23.684151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:30.900339+0000","last_change":"2022-03-21T13:54:27.176740+0000","last_active":"2022-03-21T13:54:30.900339+0000","last_peered":"2022-03-21T13:54:30.900339+0000","last_clean":"2022-03-21T13:54:30.900339+0000","last_became_active":"2022-03-21T13:54:27.176438+0000","last_became_peered":"2022-03-21T13:54:27.176438+0000","last_unstale":"2022-03-21T13:54:30.900339+0000","last_undegraded":"2022-03-21T13:54:30.900339+0000","last_fullsized":"2022-03-21T13:54:30.900339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:30:43.910676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.549588+0000","last_change":"2022-03-21T13:54:27.546515+0000","last_active":"2022-03-21T13:54:27.549588+0000","last_peered":"2022-03-21T13:54:27.549588+0000","last_clean":"2022-03-21T13:54:27.549588+0000","last_became_active":"2022-03-21T13:54:27.546277+0000","last_became_peered":"2022-03-21T13:54:27.546277+0000","last_unstale":"2022-03-21T13:54:27.549588+0000","last_undegraded":"2022-03-21T13:54:27.549588+0000","last_fullsized":"2022-03-21T13:54:27.549588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:55:14.541373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538652+0000","last_change":"2022-03-21T13:54:27.173718+0000","last_active":"2022-03-21T13:54:27.538652+0000","last_peered":"2022-03-21T13:54:27.538652+0000","last_clean":"2022-03-21T13:54:27.538652+0000","last_became_active":"2022-03-21T13:54:27.173384+0000","last_became_peered":"2022-03-21T13:54:27.173384+0000","last_unstale":"2022-03-21T13:54:27.538652+0000","last_undegraded":"2022-03-21T13:54:27.538652+0000","last_fullsized":"2022-03-21T13:54:27.538652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:27:30.485761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561445+0000","last_change":"2022-03-21T13:54:27.553332+0000","last_active":"2022-03-21T13:54:27.561445+0000","last_peered":"2022-03-21T13:54:27.561445+0000","last_clean":"2022-03-21T13:54:27.561445+0000","last_became_active":"2022-03-21T13:54:27.553052+0000","last_became_peered":"2022-03-21T13:54:27.553052+0000","last_unstale":"2022-03-21T13:54:27.561445+0000","last_undegraded":"2022-03-21T13:54:27.561445+0000","last_fullsized":"2022-03-21T13:54:27.561445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:04:17.341255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.542677+0000","last_change":"2022-03-21T13:54:27.181423+0000","last_active":"2022-03-21T13:54:32.542677+0000","last_peered":"2022-03-21T13:54:32.542677+0000","last_clean":"2022-03-21T13:54:32.542677+0000","last_became_active":"2022-03-21T13:54:27.181127+0000","last_became_peered":"2022-03-21T13:54:27.181127+0000","last_unstale":"2022-03-21T13:54:32.542677+0000","last_undegraded":"2022-03-21T13:54:32.542677+0000","last_fullsized":"2022-03-21T13:54:32.542677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:17:46.749032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556245+0000","last_change":"2022-03-21T13:54:27.553277+0000","last_active":"2022-03-21T13:54:27.556245+0000","last_peered":"2022-03-21T13:54:27.556245+0000","last_clean":"2022-03-21T13:54:27.556245+0000","last_became_active":"2022-03-21T13:54:27.552711+0000","last_became_peered":"2022-03-21T13:54:27.552711+0000","last_unstale":"2022-03-21T13:54:27.556245+0000","last_undegraded":"2022-03-21T13:54:27.556245+0000","last_fullsized":"2022-03-21T13:54:27.556245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:18:24.656738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.543711+0000","last_change":"2022-03-21T13:54:27.188996+0000","last_active":"2022-03-21T13:54:27.543711+0000","last_peered":"2022-03-21T13:54:27.543711+0000","last_clean":"2022-03-21T13:54:27.543711+0000","last_became_active":"2022-03-21T13:54:27.188638+0000","last_became_peered":"2022-03-21T13:54:27.188638+0000","last_unstale":"2022-03-21T13:54:27.543711+0000","last_undegraded":"2022-03-21T13:54:27.543711+0000","last_fullsized":"2022-03-21T13:54:27.543711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:49:19.960076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561350+0000","last_change":"2022-03-21T13:54:27.557724+0000","last_active":"2022-03-21T13:54:27.561350+0000","last_peered":"2022-03-21T13:54:27.561350+0000","last_clean":"2022-03-21T13:54:27.561350+0000","last_became_active":"2022-03-21T13:54:27.557422+0000","last_became_peered":"2022-03-21T13:54:27.557422+0000","last_unstale":"2022-03-21T13:54:27.561350+0000","last_undegraded":"2022-03-21T13:54:27.561350+0000","last_fullsized":"2022-03-21T13:54:27.561350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:34:17.342191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544789+0000","last_change":"2022-03-21T13:54:27.175632+0000","last_active":"2022-03-21T13:54:27.544789+0000","last_peered":"2022-03-21T13:54:27.544789+0000","last_clean":"2022-03-21T13:54:27.544789+0000","last_became_active":"2022-03-21T13:54:27.174313+0000","last_became_peered":"2022-03-21T13:54:27.174313+0000","last_unstale":"2022-03-21T13:54:27.544789+0000","last_undegraded":"2022-03-21T13:54:27.544789+0000","last_fullsized":"2022-03-21T13:54:27.544789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:31:14.846155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556557+0000","last_change":"2022-03-21T13:54:27.553933+0000","last_active":"2022-03-21T13:54:27.556557+0000","last_peered":"2022-03-21T13:54:27.556557+0000","last_clean":"2022-03-21T13:54:27.556557+0000","last_became_active":"2022-03-21T13:54:27.553667+0000","last_became_peered":"2022-03-21T13:54:27.553667+0000","last_unstale":"2022-03-21T13:54:27.556557+0000","last_undegraded":"2022-03-21T13:54:27.556557+0000","last_fullsized":"2022-03-21T13:54:27.556557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:51:01.974225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538127+0000","last_change":"2022-03-21T13:54:27.181656+0000","last_active":"2022-03-21T13:54:27.538127+0000","last_peered":"2022-03-21T13:54:27.538127+0000","last_clean":"2022-03-21T13:54:27.538127+0000","last_became_active":"2022-03-21T13:54:27.181013+0000","last_became_peered":"2022-03-21T13:54:27.181013+0000","last_unstale":"2022-03-21T13:54:27.538127+0000","last_undegraded":"2022-03-21T13:54:27.538127+0000","last_fullsized":"2022-03-21T13:54:27.538127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:08:16.370281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559632+0000","last_change":"2022-03-21T13:54:27.552507+0000","last_active":"2022-03-21T13:54:27.559632+0000","last_peered":"2022-03-21T13:54:27.559632+0000","last_clean":"2022-03-21T13:54:27.559632+0000","last_became_active":"2022-03-21T13:54:27.552244+0000","last_became_peered":"2022-03-21T13:54:27.552244+0000","last_unstale":"2022-03-21T13:54:27.559632+0000","last_undegraded":"2022-03-21T13:54:27.559632+0000","last_fullsized":"2022-03-21T13:54:27.559632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:15:46.905402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.546403+0000","last_change":"2022-03-21T13:54:27.182220+0000","last_active":"2022-03-21T13:54:32.546403+0000","last_peered":"2022-03-21T13:54:32.546403+0000","last_clean":"2022-03-21T13:54:32.546403+0000","last_became_active":"2022-03-21T13:54:27.181449+0000","last_became_peered":"2022-03-21T13:54:27.181449+0000","last_unstale":"2022-03-21T13:54:32.546403+0000","last_undegraded":"2022-03-21T13:54:32.546403+0000","last_fullsized":"2022-03-21T13:54:32.546403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:26:28.829484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544372+0000","last_change":"2022-03-21T13:54:22.752657+0000","last_active":"2022-03-21T13:54:27.544372+0000","last_peered":"2022-03-21T13:54:27.544372+0000","last_clean":"2022-03-21T13:54:27.544372+0000","last_became_active":"2022-03-21T13:54:22.752340+0000","last_became_peered":"2022-03-21T13:54:22.752340+0000","last_unstale":"2022-03-21T13:54:27.544372+0000","last_undegraded":"2022-03-21T13:54:27.544372+0000","last_fullsized":"2022-03-21T13:54:27.544372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:28:57.302130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559027+0000","last_change":"2022-03-21T13:54:27.556126+0000","last_active":"2022-03-21T13:54:27.559027+0000","last_peered":"2022-03-21T13:54:27.559027+0000","last_clean":"2022-03-21T13:54:27.559027+0000","last_became_active":"2022-03-21T13:54:27.555851+0000","last_became_peered":"2022-03-21T13:54:27.555851+0000","last_unstale":"2022-03-21T13:54:27.559027+0000","last_undegraded":"2022-03-21T13:54:27.559027+0000","last_fullsized":"2022-03-21T13:54:27.559027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:16:33.357705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538747+0000","last_change":"2022-03-21T13:54:22.516271+0000","last_active":"2022-03-21T13:54:27.538747+0000","last_peered":"2022-03-21T13:54:27.538747+0000","last_clean":"2022-03-21T13:54:27.538747+0000","last_became_active":"2022-03-21T13:54:22.516054+0000","last_became_peered":"2022-03-21T13:54:22.516054+0000","last_unstale":"2022-03-21T13:54:27.538747+0000","last_undegraded":"2022-03-21T13:54:27.538747+0000","last_fullsized":"2022-03-21T13:54:27.538747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:22:14.145694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.548707+0000","last_change":"2022-03-21T13:54:27.180161+0000","last_active":"2022-03-21T13:54:27.548707+0000","last_peered":"2022-03-21T13:54:27.548707+0000","last_clean":"2022-03-21T13:54:27.548707+0000","last_became_active":"2022-03-21T13:54:27.179861+0000","last_became_peered":"2022-03-21T13:54:27.179861+0000","last_unstale":"2022-03-21T13:54:27.548707+0000","last_undegraded":"2022-03-21T13:54:27.548707+0000","last_fullsized":"2022-03-21T13:54:27.548707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:54:59.570703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.559390+0000","last_change":"2022-03-21T13:54:27.554664+0000","last_active":"2022-03-21T13:54:27.559390+0000","last_peered":"2022-03-21T13:54:27.559390+0000","last_clean":"2022-03-21T13:54:27.559390+0000","last_became_active":"2022-03-21T13:54:27.554348+0000","last_became_peered":"2022-03-21T13:54:27.554348+0000","last_unstale":"2022-03-21T13:54:27.559390+0000","last_undegraded":"2022-03-21T13:54:27.559390+0000","last_fullsized":"2022-03-21T13:54:27.559390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:57:45.927949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.546570+0000","last_change":"2022-03-21T13:54:22.517332+0000","last_active":"2022-03-21T13:54:27.546570+0000","last_peered":"2022-03-21T13:54:27.546570+0000","last_clean":"2022-03-21T13:54:27.546570+0000","last_became_active":"2022-03-21T13:54:22.517041+0000","last_became_peered":"2022-03-21T13:54:22.517041+0000","last_unstale":"2022-03-21T13:54:27.546570+0000","last_undegraded":"2022-03-21T13:54:27.546570+0000","last_fullsized":"2022-03-21T13:54:27.546570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:35:30.629523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552331+0000","last_change":"2022-03-21T13:54:22.518907+0000","last_active":"2022-03-21T13:54:27.552331+0000","last_peered":"2022-03-21T13:54:27.552331+0000","last_clean":"2022-03-21T13:54:27.552331+0000","last_became_active":"2022-03-21T13:54:22.518133+0000","last_became_peered":"2022-03-21T13:54:22.518133+0000","last_unstale":"2022-03-21T13:54:27.552331+0000","last_undegraded":"2022-03-21T13:54:27.552331+0000","last_fullsized":"2022-03-21T13:54:27.552331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:30:34.855709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.550369+0000","last_change":"2022-03-21T13:54:27.176117+0000","last_active":"2022-03-21T13:54:27.550369+0000","last_peered":"2022-03-21T13:54:27.550369+0000","last_clean":"2022-03-21T13:54:27.550369+0000","last_became_active":"2022-03-21T13:54:27.175777+0000","last_became_peered":"2022-03-21T13:54:27.175777+0000","last_unstale":"2022-03-21T13:54:27.550369+0000","last_undegraded":"2022-03-21T13:54:27.550369+0000","last_fullsized":"2022-03-21T13:54:27.550369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T20:10:54.616279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564761+0000","last_change":"2022-03-21T13:54:27.557887+0000","last_active":"2022-03-21T13:54:27.564761+0000","last_peered":"2022-03-21T13:54:27.564761+0000","last_clean":"2022-03-21T13:54:27.564761+0000","last_became_active":"2022-03-21T13:54:27.556863+0000","last_became_peered":"2022-03-21T13:54:27.556863+0000","last_unstale":"2022-03-21T13:54:27.564761+0000","last_undegraded":"2022-03-21T13:54:27.564761+0000","last_fullsized":"2022-03-21T13:54:27.564761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:12:33.174945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552437+0000","last_change":"2022-03-21T13:54:22.754462+0000","last_active":"2022-03-21T13:54:27.552437+0000","last_peered":"2022-03-21T13:54:27.552437+0000","last_clean":"2022-03-21T13:54:27.552437+0000","last_became_active":"2022-03-21T13:54:22.754181+0000","last_became_peered":"2022-03-21T13:54:22.754181+0000","last_unstale":"2022-03-21T13:54:27.552437+0000","last_undegraded":"2022-03-21T13:54:27.552437+0000","last_fullsized":"2022-03-21T13:54:27.552437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:14:20.288360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.545206+0000","last_change":"2022-03-21T13:54:27.179213+0000","last_active":"2022-03-21T13:54:27.545206+0000","last_peered":"2022-03-21T13:54:27.545206+0000","last_clean":"2022-03-21T13:54:27.545206+0000","last_became_active":"2022-03-21T13:54:27.178915+0000","last_became_peered":"2022-03-21T13:54:27.178915+0000","last_unstale":"2022-03-21T13:54:27.545206+0000","last_undegraded":"2022-03-21T13:54:27.545206+0000","last_fullsized":"2022-03-21T13:54:27.545206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:13:42.024350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552944+0000","last_change":"2022-03-21T13:54:27.547854+0000","last_active":"2022-03-21T13:54:27.552944+0000","last_peered":"2022-03-21T13:54:27.552944+0000","last_clean":"2022-03-21T13:54:27.552944+0000","last_became_active":"2022-03-21T13:54:27.547604+0000","last_became_peered":"2022-03-21T13:54:27.547604+0000","last_unstale":"2022-03-21T13:54:27.552944+0000","last_undegraded":"2022-03-21T13:54:27.552944+0000","last_fullsized":"2022-03-21T13:54:27.552944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:32:19.271632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552230+0000","last_change":"2022-03-21T13:54:22.754729+0000","last_active":"2022-03-21T13:54:27.552230+0000","last_peered":"2022-03-21T13:54:27.552230+0000","last_clean":"2022-03-21T13:54:27.552230+0000","last_became_active":"2022-03-21T13:54:22.754461+0000","last_became_peered":"2022-03-21T13:54:22.754461+0000","last_unstale":"2022-03-21T13:54:27.552230+0000","last_undegraded":"2022-03-21T13:54:27.552230+0000","last_fullsized":"2022-03-21T13:54:27.552230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:46:22.855169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.538243+0000","last_change":"2022-03-21T13:54:27.174663+0000","last_active":"2022-03-21T13:54:27.538243+0000","last_peered":"2022-03-21T13:54:27.538243+0000","last_clean":"2022-03-21T13:54:27.538243+0000","last_became_active":"2022-03-21T13:54:27.174374+0000","last_became_peered":"2022-03-21T13:54:27.174374+0000","last_unstale":"2022-03-21T13:54:27.538243+0000","last_undegraded":"2022-03-21T13:54:27.538243+0000","last_fullsized":"2022-03-21T13:54:27.538243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:56:26.094511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561738+0000","last_change":"2022-03-21T13:54:27.554233+0000","last_active":"2022-03-21T13:54:27.561738+0000","last_peered":"2022-03-21T13:54:27.561738+0000","last_clean":"2022-03-21T13:54:27.561738+0000","last_became_active":"2022-03-21T13:54:27.554000+0000","last_became_peered":"2022-03-21T13:54:27.554000+0000","last_unstale":"2022-03-21T13:54:27.561738+0000","last_undegraded":"2022-03-21T13:54:27.561738+0000","last_fullsized":"2022-03-21T13:54:27.561738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:06:56.350790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.539757+0000","last_change":"2022-03-21T13:54:22.754834+0000","last_active":"2022-03-21T13:54:27.539757+0000","last_peered":"2022-03-21T13:54:27.539757+0000","last_clean":"2022-03-21T13:54:27.539757+0000","last_became_active":"2022-03-21T13:54:22.754559+0000","last_became_peered":"2022-03-21T13:54:22.754559+0000","last_unstale":"2022-03-21T13:54:27.539757+0000","last_undegraded":"2022-03-21T13:54:27.539757+0000","last_fullsized":"2022-03-21T13:54:27.539757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:12:50.878537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.544326+0000","last_change":"2022-03-21T13:54:27.181111+0000","last_active":"2022-03-21T13:54:27.544326+0000","last_peered":"2022-03-21T13:54:27.544326+0000","last_clean":"2022-03-21T13:54:27.544326+0000","last_became_active":"2022-03-21T13:54:27.180843+0000","last_became_peered":"2022-03-21T13:54:27.180843+0000","last_unstale":"2022-03-21T13:54:27.544326+0000","last_undegraded":"2022-03-21T13:54:27.544326+0000","last_fullsized":"2022-03-21T13:54:27.544326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:59:38.064620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563441+0000","last_change":"2022-03-21T13:54:27.559540+0000","last_active":"2022-03-21T13:54:27.563441+0000","last_peered":"2022-03-21T13:54:27.563441+0000","last_clean":"2022-03-21T13:54:27.563441+0000","last_became_active":"2022-03-21T13:54:27.559138+0000","last_became_peered":"2022-03-21T13:54:27.559138+0000","last_unstale":"2022-03-21T13:54:27.563441+0000","last_undegraded":"2022-03-21T13:54:27.563441+0000","last_fullsized":"2022-03-21T13:54:27.563441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:00:54.639756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.543099+0000","last_change":"2022-03-21T13:54:22.754654+0000","last_active":"2022-03-21T13:54:27.543099+0000","last_peered":"2022-03-21T13:54:27.543099+0000","last_clean":"2022-03-21T13:54:27.543099+0000","last_became_active":"2022-03-21T13:54:22.754341+0000","last_became_peered":"2022-03-21T13:54:22.754341+0000","last_unstale":"2022-03-21T13:54:27.543099+0000","last_undegraded":"2022-03-21T13:54:27.543099+0000","last_fullsized":"2022-03-21T13:54:27.543099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:03:23.378195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.545941+0000","last_change":"2022-03-21T13:54:27.177438+0000","last_active":"2022-03-21T13:54:27.545941+0000","last_peered":"2022-03-21T13:54:27.545941+0000","last_clean":"2022-03-21T13:54:27.545941+0000","last_became_active":"2022-03-21T13:54:27.177162+0000","last_became_peered":"2022-03-21T13:54:27.177162+0000","last_unstale":"2022-03-21T13:54:27.545941+0000","last_undegraded":"2022-03-21T13:54:27.545941+0000","last_fullsized":"2022-03-21T13:54:27.545941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:28:43.052052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.564772+0000","last_change":"2022-03-21T13:54:27.561906+0000","last_active":"2022-03-21T13:54:27.564772+0000","last_peered":"2022-03-21T13:54:27.564772+0000","last_clean":"2022-03-21T13:54:27.564772+0000","last_became_active":"2022-03-21T13:54:27.561625+0000","last_became_peered":"2022-03-21T13:54:27.561625+0000","last_unstale":"2022-03-21T13:54:27.564772+0000","last_undegraded":"2022-03-21T13:54:27.564772+0000","last_fullsized":"2022-03-21T13:54:27.564772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T22:56:25.047015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.543299+0000","last_change":"2022-03-21T13:54:22.516420+0000","last_active":"2022-03-21T13:54:27.543299+0000","last_peered":"2022-03-21T13:54:27.543299+0000","last_clean":"2022-03-21T13:54:27.543299+0000","last_became_active":"2022-03-21T13:54:22.516110+0000","last_became_peered":"2022-03-21T13:54:22.516110+0000","last_unstale":"2022-03-21T13:54:27.543299+0000","last_undegraded":"2022-03-21T13:54:27.543299+0000","last_fullsized":"2022-03-21T13:54:27.543299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:21.500037+0000","last_clean_scrub_stamp":"2022-03-21T13:54:21.500037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:05:13.607013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.539334+0000","last_change":"2022-03-21T13:54:27.173580+0000","last_active":"2022-03-21T13:54:27.539334+0000","last_peered":"2022-03-21T13:54:27.539334+0000","last_clean":"2022-03-21T13:54:27.539334+0000","last_became_active":"2022-03-21T13:54:27.173258+0000","last_became_peered":"2022-03-21T13:54:27.173258+0000","last_unstale":"2022-03-21T13:54:27.539334+0000","last_undegraded":"2022-03-21T13:54:27.539334+0000","last_fullsized":"2022-03-21T13:54:27.539334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:47:44.915765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552991+0000","last_change":"2022-03-21T13:54:27.548735+0000","last_active":"2022-03-21T13:54:27.552991+0000","last_peered":"2022-03-21T13:54:27.552991+0000","last_clean":"2022-03-21T13:54:27.552991+0000","last_became_active":"2022-03-21T13:54:27.548473+0000","last_became_peered":"2022-03-21T13:54:27.548473+0000","last_unstale":"2022-03-21T13:54:27.552991+0000","last_undegraded":"2022-03-21T13:54:27.552991+0000","last_fullsized":"2022-03-21T13:54:27.552991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:39:55.442576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:30.899423+0000","last_change":"2022-03-21T13:54:27.189213+0000","last_active":"2022-03-21T13:54:30.899423+0000","last_peered":"2022-03-21T13:54:30.899423+0000","last_clean":"2022-03-21T13:54:30.899423+0000","last_became_active":"2022-03-21T13:54:27.188926+0000","last_became_peered":"2022-03-21T13:54:27.188926+0000","last_unstale":"2022-03-21T13:54:30.899423+0000","last_undegraded":"2022-03-21T13:54:30.899423+0000","last_fullsized":"2022-03-21T13:54:30.899423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:16:55.866231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.561826+0000","last_change":"2022-03-21T13:54:27.556471+0000","last_active":"2022-03-21T13:54:27.561826+0000","last_peered":"2022-03-21T13:54:27.561826+0000","last_clean":"2022-03-21T13:54:27.561826+0000","last_became_active":"2022-03-21T13:54:27.556191+0000","last_became_peered":"2022-03-21T13:54:27.556191+0000","last_unstale":"2022-03-21T13:54:27.561826+0000","last_undegraded":"2022-03-21T13:54:27.561826+0000","last_fullsized":"2022-03-21T13:54:27.561826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:05:34.443958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547761+0000","last_change":"2022-03-21T13:54:27.177405+0000","last_active":"2022-03-21T13:54:32.547761+0000","last_peered":"2022-03-21T13:54:32.547761+0000","last_clean":"2022-03-21T13:54:32.547761+0000","last_became_active":"2022-03-21T13:54:27.177179+0000","last_became_peered":"2022-03-21T13:54:27.177179+0000","last_unstale":"2022-03-21T13:54:32.547761+0000","last_undegraded":"2022-03-21T13:54:32.547761+0000","last_fullsized":"2022-03-21T13:54:32.547761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:41:46.492410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556386+0000","last_change":"2022-03-21T13:54:27.552397+0000","last_active":"2022-03-21T13:54:27.556386+0000","last_peered":"2022-03-21T13:54:27.556386+0000","last_clean":"2022-03-21T13:54:27.556386+0000","last_became_active":"2022-03-21T13:54:27.552124+0000","last_became_peered":"2022-03-21T13:54:27.552124+0000","last_unstale":"2022-03-21T13:54:27.556386+0000","last_undegraded":"2022-03-21T13:54:27.556386+0000","last_fullsized":"2022-03-21T13:54:27.556386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T00:53:44.559771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.547691+0000","last_change":"2022-03-21T13:54:27.174486+0000","last_active":"2022-03-21T13:54:32.547691+0000","last_peered":"2022-03-21T13:54:32.547691+0000","last_clean":"2022-03-21T13:54:32.547691+0000","last_became_active":"2022-03-21T13:54:27.174216+0000","last_became_peered":"2022-03-21T13:54:27.174216+0000","last_unstale":"2022-03-21T13:54:32.547691+0000","last_undegraded":"2022-03-21T13:54:32.547691+0000","last_fullsized":"2022-03-21T13:54:32.547691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:48:33.845336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.552669+0000","last_change":"2022-03-21T13:54:27.545286+0000","last_active":"2022-03-21T13:54:27.552669+0000","last_peered":"2022-03-21T13:54:27.552669+0000","last_clean":"2022-03-21T13:54:27.552669+0000","last_became_active":"2022-03-21T13:54:27.544961+0000","last_became_peered":"2022-03-21T13:54:27.544961+0000","last_unstale":"2022-03-21T13:54:27.552669+0000","last_undegraded":"2022-03-21T13:54:27.552669+0000","last_fullsized":"2022-03-21T13:54:27.552669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T14:48:39.601897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:30.895867+0000","last_change":"2022-03-21T13:54:27.178370+0000","last_active":"2022-03-21T13:54:30.895867+0000","last_peered":"2022-03-21T13:54:30.895867+0000","last_clean":"2022-03-21T13:54:30.895867+0000","last_became_active":"2022-03-21T13:54:27.178080+0000","last_became_peered":"2022-03-21T13:54:27.178080+0000","last_unstale":"2022-03-21T13:54:30.895867+0000","last_undegraded":"2022-03-21T13:54:30.895867+0000","last_fullsized":"2022-03-21T13:54:30.895867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:27:35.506923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.563042+0000","last_change":"2022-03-21T13:54:27.557416+0000","last_active":"2022-03-21T13:54:27.563042+0000","last_peered":"2022-03-21T13:54:27.563042+0000","last_clean":"2022-03-21T13:54:27.563042+0000","last_became_active":"2022-03-21T13:54:27.557109+0000","last_became_peered":"2022-03-21T13:54:27.557109+0000","last_unstale":"2022-03-21T13:54:27.563042+0000","last_undegraded":"2022-03-21T13:54:27.563042+0000","last_fullsized":"2022-03-21T13:54:27.563042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T17:54:56.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-03-21T13:54:32.546643+0000","last_change":"2022-03-21T13:54:27.177642+0000","last_active":"2022-03-21T13:54:32.546643+0000","last_peered":"2022-03-21T13:54:32.546643+0000","last_clean":"2022-03-21T13:54:32.546643+0000","last_became_active":"2022-03-21T13:54:27.176415+0000","last_became_peered":"2022-03-21T13:54:27.176415+0000","last_unstale":"2022-03-21T13:54:32.546643+0000","last_undegraded":"2022-03-21T13:54:32.546643+0000","last_fullsized":"2022-03-21T13:54:32.546643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:26.149854+0000","last_clean_scrub_stamp":"2022-03-21T13:54:26.149854+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T16:07:20.332858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554536+0000","last_change":"2022-03-21T13:54:27.548038+0000","last_active":"2022-03-21T13:54:27.554536+0000","last_peered":"2022-03-21T13:54:27.554536+0000","last_clean":"2022-03-21T13:54:27.554536+0000","last_became_active":"2022-03-21T13:54:27.547693+0000","last_became_peered":"2022-03-21T13:54:27.547693+0000","last_unstale":"2022-03-21T13:54:27.554536+0000","last_undegraded":"2022-03-21T13:54:27.554536+0000","last_fullsized":"2022-03-21T13:54:27.554536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:20:34.987871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.566096+0000","last_change":"2022-03-21T13:54:27.557329+0000","last_active":"2022-03-21T13:54:27.566096+0000","last_peered":"2022-03-21T13:54:27.566096+0000","last_clean":"2022-03-21T13:54:27.566096+0000","last_became_active":"2022-03-21T13:54:27.557050+0000","last_became_peered":"2022-03-21T13:54:27.557050+0000","last_unstale":"2022-03-21T13:54:27.566096+0000","last_undegraded":"2022-03-21T13:54:27.566096+0000","last_fullsized":"2022-03-21T13:54:27.566096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-23T01:29:21.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.556375+0000","last_change":"2022-03-21T13:54:27.554172+0000","last_active":"2022-03-21T13:54:27.556375+0000","last_peered":"2022-03-21T13:54:27.556375+0000","last_clean":"2022-03-21T13:54:27.556375+0000","last_became_active":"2022-03-21T13:54:27.553846+0000","last_became_peered":"2022-03-21T13:54:27.553846+0000","last_unstale":"2022-03-21T13:54:27.556375+0000","last_undegraded":"2022-03-21T13:54:27.556375+0000","last_fullsized":"2022-03-21T13:54:27.556375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T15:26:44.119561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.554578+0000","last_change":"2022-03-21T13:54:27.547824+0000","last_active":"2022-03-21T13:54:27.554578+0000","last_peered":"2022-03-21T13:54:27.554578+0000","last_clean":"2022-03-21T13:54:27.554578+0000","last_became_active":"2022-03-21T13:54:27.547518+0000","last_became_peered":"2022-03-21T13:54:27.547518+0000","last_unstale":"2022-03-21T13:54:27.554578+0000","last_undegraded":"2022-03-21T13:54:27.554578+0000","last_fullsized":"2022-03-21T13:54:27.554578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T18:51:03.595275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562755+0000","last_change":"2022-03-21T13:54:27.557697+0000","last_active":"2022-03-21T13:54:27.562755+0000","last_peered":"2022-03-21T13:54:27.562755+0000","last_clean":"2022-03-21T13:54:27.562755+0000","last_became_active":"2022-03-21T13:54:27.557422+0000","last_became_peered":"2022-03-21T13:54:27.557422+0000","last_unstale":"2022-03-21T13:54:27.562755+0000","last_undegraded":"2022-03-21T13:54:27.562755+0000","last_fullsized":"2022-03-21T13:54:27.562755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T21:19:10.850615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2022-03-21T13:54:27.562316+0000","last_change":"2022-03-21T13:54:27.555304+0000","last_active":"2022-03-21T13:54:27.562316+0000","last_peered":"2022-03-21T13:54:27.562316+0000","last_clean":"2022-03-21T13:54:27.562316+0000","last_became_active":"2022-03-21T13:54:27.555046+0000","last_became_peered":"2022-03-21T13:54:27.555046+0000","last_unstale":"2022-03-21T13:54:27.562316+0000","last_undegraded":"2022-03-21T13:54:27.562316+0000","last_fullsized":"2022-03-21T13:54:27.562316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-21T13:54:27.156431+0000","last_clean_scrub_stamp":"2022-03-21T13:54:27.156431+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-22T23:20:53.409319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":58760,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9000,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362840,"statfs":{"total":96636764160,"available":96627548160,"internally_reserved":0,"allocated":294912,"data_stored":604872,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":74180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8972,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362868,"statfs":{"total":96636764160,"available":96627576832,"internally_reserved":0,"allocated":266240,"data_stored":603108,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8468,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363372,"statfs":{"total":96636764160,"available":96628092928,"internally_reserved":0,"allocated":208896,"data_stored":74746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":74180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8468,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363372,"statfs":{"total":96636764160,"available":96628092928,"internally_reserved":0,"allocated":208896,"data_stored":74270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":225280,"data_stored":75784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8408,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363432,"statfs":{"total":96636764160,"available":96628154368,"internally_reserved":0,"allocated":212992,"data_stored":74816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29380,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-03-21T13:54:38.036 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-03-21T13:54:38.037 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-03-21T13:54:38.037 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-03-21T13:54:38.037 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-03-21T13:54:38.182 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.180+0000 7fb76bf1c700 1 Processor -- start 2022-03-21T13:54:38.182 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.180+0000 7fb76bf1c700 1 -- start start 2022-03-21T13:54:38.185 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb76bf1c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb76414eb10 0x7fb764067bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:38.185 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb76bf1c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7640b7350 0x7fb7640c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:38.185 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb76bf1c700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76406ce20 con 0x7fb764155310 2022-03-21T13:54:38.186 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb76bf1c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7640c3480 con 0x7fb76414eb10 2022-03-21T13:54:38.186 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb76bf1c700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb764155850 con 0x7fb7640b7350 2022-03-21T13:54:38.186 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb769cb8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb76414eb10 0x7fb764067bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:38.186 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb769cb8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb76414eb10 0x7fb764067bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56820/0 (socket says 172.21.15.160:56820) 2022-03-21T13:54:38.187 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb769cb8700 1 -- 172.21.15.160:0/1775990444 learned_addr learned my addr 172.21.15.160:0/1775990444 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:38.187 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb7694b7700 1 --2- 172.21.15.160:0/1775990444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7640b7350 0x7fb7640c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:38.187 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb769cb8700 1 -- 172.21.15.160:0/1775990444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7640b7350 msgr2=0x7fb7640c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:38.187 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb769cb8700 1 --2- 172.21.15.160:0/1775990444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7640b7350 0x7fb7640c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.187 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb769cb8700 1 -- 172.21.15.160:0/1775990444 >> v1:172.21.15.171:6789/0 conn(0x7fb764155310 legacy=0x7fb764157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:38.188 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.181+0000 7fb769cb8700 1 -- 172.21.15.160:0/1775990444 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640c29b0 con 0x7fb76414eb10 2022-03-21T13:54:38.188 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb769cb8700 1 --2- 172.21.15.160:0/1775990444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb76414eb10 0x7fb764067bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb754009f20 tx=0x7fb754009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ec5b075cebdcf server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:38.188 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb768cb6700 1 -- 172.21.15.160:0/1775990444 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75400e070 con 0x7fb76414eb10 2022-03-21T13:54:38.188 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb768cb6700 1 -- 172.21.15.160:0/1775990444 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75400ba40 con 0x7fb76414eb10 2022-03-21T13:54:38.189 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb768cb6700 1 -- 172.21.15.160:0/1775990444 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7540092e0 con 0x7fb76414eb10 2022-03-21T13:54:38.189 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb76bf1c700 1 -- 172.21.15.160:0/1775990444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb76414eb10 msgr2=0x7fb764067bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:38.189 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb76bf1c700 1 --2- 172.21.15.160:0/1775990444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb76414eb10 0x7fb764067bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb754009f20 tx=0x7fb754009840 comp rx=0 tx=0).stop 2022-03-21T13:54:38.189 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb76bf1c700 1 -- 172.21.15.160:0/1775990444 shutdown_connections 2022-03-21T13:54:38.189 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb76bf1c700 1 --2- 172.21.15.160:0/1775990444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb76414eb10 0x7fb764067bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.190 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb76bf1c700 1 --2- 172.21.15.160:0/1775990444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7640b7350 0x7fb7640c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.190 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb76bf1c700 1 -- 172.21.15.160:0/1775990444 >> 172.21.15.160:0/1775990444 conn(0x7fb7640c7f50 msgr2=0x7fb7640c3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:38.190 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb76bf1c700 1 -- 172.21.15.160:0/1775990444 shutdown_connections 2022-03-21T13:54:38.190 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.182+0000 7fb76bf1c700 1 -- 172.21.15.160:0/1775990444 wait complete. 2022-03-21T13:54:38.191 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.183+0000 7fb76bf1c700 1 Processor -- start 2022-03-21T13:54:38.191 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.183+0000 7fb76bf1c700 1 -- start start 2022-03-21T13:54:38.194 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb76bf1c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7640b7350 0x7fb76414b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:38.194 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb76bf1c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb76414eb10 0x7fb764158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:38.194 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb76bf1c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb764155310 0x7fb764159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:38.194 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb76bf1c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7641501a0 con 0x7fb76414eb10 2022-03-21T13:54:38.195 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb76bf1c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76415ca10 con 0x7fb764155310 2022-03-21T13:54:38.195 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb76bf1c700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76414f2b0 con 0x7fb7640b7350 2022-03-21T13:54:38.195 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb7694b7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb76414eb10 0x7fb764158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:38.195 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb7694b7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb76414eb10 0x7fb764158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56824/0 (socket says 172.21.15.160:56824) 2022-03-21T13:54:38.195 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb7694b7700 1 -- 172.21.15.160:0/2978783493 learned_addr learned my addr 172.21.15.160:0/2978783493 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:38.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb769cb8700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7640b7350 0x7fb76414b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:38.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb76a4b9700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb764155310 0x7fb764159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:38.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb7694b7700 1 -- 172.21.15.160:0/2978783493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7640b7350 msgr2=0x7fb76414b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:38.196 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb7694b7700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7640b7350 0x7fb76414b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.197 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb7694b7700 1 -- 172.21.15.160:0/2978783493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb764155310 msgr2=0x7fb764159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:38.197 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb7694b7700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb764155310 0x7fb764159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.197 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.184+0000 7fb7694b7700 1 -- 172.21.15.160:0/2978783493 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754009ae0 con 0x7fb76414eb10 2022-03-21T13:54:38.197 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.185+0000 7fb7694b7700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb76414eb10 0x7fb764158f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c850 tx=0x7fb758008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:38.197 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.185+0000 7fb761ffb700 1 -- 172.21.15.160:0/2978783493 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758004020 con 0x7fb76414eb10 2022-03-21T13:54:38.198 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.185+0000 7fb761ffb700 1 -- 172.21.15.160:0/2978783493 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb758004180 con 0x7fb76414eb10 2022-03-21T13:54:38.198 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.185+0000 7fb76bf1c700 1 -- 172.21.15.160:0/2978783493 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76414f590 con 0x7fb76414eb10 2022-03-21T13:54:38.198 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.185+0000 7fb761ffb700 1 -- 172.21.15.160:0/2978783493 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758011600 con 0x7fb76414eb10 2022-03-21T13:54:38.198 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.185+0000 7fb76bf1c700 1 -- 172.21.15.160:0/2978783493 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76414fb50 con 0x7fb76414eb10 2022-03-21T13:54:38.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.186+0000 7fb76bf1c700 1 -- 172.21.15.160:0/2978783493 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76406fc00 con 0x7fb76414eb10 2022-03-21T13:54:38.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.186+0000 7fb761ffb700 1 -- 172.21.15.160:0/2978783493 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fb758011a30 con 0x7fb76414eb10 2022-03-21T13:54:38.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.187+0000 7fb761ffb700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb744063d10 0x7fb7440661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:38.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.187+0000 7fb761ffb700 1 -- 172.21.15.160:0/2978783493 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb758080830 con 0x7fb76414eb10 2022-03-21T13:54:38.199 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.187+0000 7fb769cb8700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb744063d10 0x7fb7440661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:38.200 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.187+0000 7fb769cb8700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb744063d10 0x7fb7440661c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb754009880 tx=0x7fb754017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:38.200 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.191+0000 7fb761ffb700 1 -- 172.21.15.160:0/2978783493 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fb75804f410 con 0x7fb76414eb10 2022-03-21T13:54:38.410 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.408+0000 7fb76bf1c700 1 -- 172.21.15.160:0/2978783493 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb764070170 con 0x7fb76414eb10 2022-03-21T13:54:38.411 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.408+0000 7fb761ffb700 1 -- 172.21.15.160:0/2978783493 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+196 (secure 0 0 0) 0x7fb758015020 con 0x7fb76414eb10 2022-03-21T13:54:38.411 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:38.411 INFO:teuthology.orchestra.run.smithi160.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2022-03-21T13:54:38.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.410+0000 7fb76bf1c700 1 -- 172.21.15.160:0/2978783493 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb744063d10 msgr2=0x7fb7440661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:38.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.410+0000 7fb76bf1c700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb744063d10 0x7fb7440661c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb754009880 tx=0x7fb754017000 comp rx=0 tx=0).stop 2022-03-21T13:54:38.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.410+0000 7fb76bf1c700 1 -- 172.21.15.160:0/2978783493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb76414eb10 msgr2=0x7fb764158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:38.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.410+0000 7fb76bf1c700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb76414eb10 0x7fb764158f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c850 tx=0x7fb758008040 comp rx=0 tx=0).stop 2022-03-21T13:54:38.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.410+0000 7fb76bf1c700 1 -- 172.21.15.160:0/2978783493 shutdown_connections 2022-03-21T13:54:38.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.410+0000 7fb76bf1c700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fb744063d10 0x7fb7440661c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.410+0000 7fb76bf1c700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb764155310 0x7fb764159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.410+0000 7fb76bf1c700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7640b7350 0x7fb76414b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.410+0000 7fb76bf1c700 1 --2- 172.21.15.160:0/2978783493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb76414eb10 0x7fb764158f20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:38.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.410+0000 7fb76bf1c700 1 -- 172.21.15.160:0/2978783493 >> 172.21.15.160:0/2978783493 conn(0x7fb7640c7f50 msgr2=0x7fb76406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:38.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.411+0000 7fb76bf1c700 1 -- 172.21.15.160:0/2978783493 shutdown_connections 2022-03-21T13:54:38.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:38.411+0000 7fb76bf1c700 1 -- 172.21.15.160:0/2978783493 wait complete. 2022-03-21T13:54:38.649 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T13:54:38.648+0000 7f69037bb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2022-03-21T13:54:38.650 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T13:54:38.648+0000 7f69037bb700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2022-03-21T13:54:41.425 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-03-21T13:54:41.551 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.549+0000 7fd103906700 1 Processor -- start 2022-03-21T13:54:41.551 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.549+0000 7fd103906700 1 -- start start 2022-03-21T13:54:41.559 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.550+0000 7fd103906700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd0fc06aa40 0x7fd0fc06b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:41.559 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.550+0000 7fd103906700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc06b520 con 0x7fd0fc06a080 2022-03-21T13:54:41.559 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.550+0000 7fd103906700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc0c6b00 con 0x7fd0fc06c910 2022-03-21T13:54:41.559 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.550+0000 7fd103906700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc0c7300 con 0x7fd0fc06aa40 2022-03-21T13:54:41.560 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.550+0000 7fd100ea1700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fd0fc06a080 0x7fd0fc06ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:60000/0 (socket says 172.21.15.160:60000) 2022-03-21T13:54:41.560 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.550+0000 7fd100ea1700 1 -- 172.21.15.160:0/2598229218 learned_addr learned my addr 172.21.15.160:0/2598229218 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:41.560 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd1016a2700 1 --2- 172.21.15.160:0/2598229218 >> v2:172.21.15.171:3300/0 conn(0x7fd0fc06aa40 0x7fd0fc06b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:41.560 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396369637 0 0) 0x7fd0fc06b520 con 0x7fd0fc06a080 2022-03-21T13:54:41.560 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0e80033f0 con 0x7fd0fc06a080 2022-03-21T13:54:41.561 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1094454467 0 0) 0x7fd0e80033f0 con 0x7fd0fc06a080 2022-03-21T13:54:41.561 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 >> v2:172.21.15.171:3300/0 conn(0x7fd0fc06aa40 msgr2=0x7fd0fc06b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:41.561 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 --2- 172.21.15.160:0/2598229218 >> v2:172.21.15.171:3300/0 conn(0x7fd0fc06aa40 0x7fd0fc06b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:41.561 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 >> v1:172.21.15.171:6789/0 conn(0x7fd0fc06c910 legacy=0x7fd0fc06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:41.562 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0c8620 con 0x7fd0fc06a080 2022-03-21T13:54:41.562 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7fd0f0001470 con 0x7fd0fc06a080 2022-03-21T13:54:41.562 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 >> v1:172.21.15.160:6789/0 conn(0x7fd0fc06a080 legacy=0x7fd0fc06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:41.562 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 --2- 172.21.15.160:0/2598229218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e80038e0 0x7fd0e8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:41.563 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 --2- 172.21.15.160:0/2598229218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e8004690 0x7fd0e8004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:41.563 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 --2- 172.21.15.160:0/2598229218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0e8005040 0x7fd0e800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:41.563 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0c7300 con 0x7fd0e8005040 2022-03-21T13:54:41.563 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e800bfe0 con 0x7fd0e8004690 2022-03-21T13:54:41.563 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e800c1a0 con 0x7fd0e80038e0 2022-03-21T13:54:41.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd101ea3700 1 --2- 172.21.15.160:0/2598229218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0e8005040 0x7fd0e800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:41.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd100ea1700 1 --2- 172.21.15.160:0/2598229218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e8004690 0x7fd0e8004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:41.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd1016a2700 1 --2- 172.21.15.160:0/2598229218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e80038e0 0x7fd0e8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:41.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd101ea3700 1 -- 172.21.15.160:0/2598229218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e80038e0 msgr2=0x7fd0e8003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:41.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd101ea3700 1 --2- 172.21.15.160:0/2598229218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e80038e0 0x7fd0e8003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:41.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd101ea3700 1 -- 172.21.15.160:0/2598229218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e8004690 msgr2=0x7fd0e8004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:41.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd101ea3700 1 --2- 172.21.15.160:0/2598229218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e8004690 0x7fd0e8004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:41.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd101ea3700 1 -- 172.21.15.160:0/2598229218 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e80033f0 con 0x7fd0e8005040 2022-03-21T13:54:41.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd101ea3700 1 -- 172.21.15.160:0/2598229218 reap_dead start 2022-03-21T13:54:41.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.551+0000 7fd101ea3700 1 --2- 172.21.15.160:0/2598229218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0e8005040 0x7fd0e800b8e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001740 tx=0x7fd0f4007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cb7fd69b407d1e server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:41.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.552+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40050d0 con 0x7fd0e8005040 2022-03-21T13:54:41.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.552+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f4005230 con 0x7fd0e8005040 2022-03-21T13:54:41.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.552+0000 7fd0fbfff700 1 -- 172.21.15.160:0/2598229218 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4003710 con 0x7fd0e8005040 2022-03-21T13:54:41.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.552+0000 7fd103906700 1 -- 172.21.15.160:0/2598229218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0e8005040 msgr2=0x7fd0e800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:41.567 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.552+0000 7fd103906700 1 --2- 172.21.15.160:0/2598229218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0e8005040 0x7fd0e800b8e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001740 tx=0x7fd0f4007b70 comp rx=0 tx=0).stop 2022-03-21T13:54:41.567 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.552+0000 7fd103906700 1 -- 172.21.15.160:0/2598229218 shutdown_connections 2022-03-21T13:54:41.567 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.552+0000 7fd103906700 1 --2- 172.21.15.160:0/2598229218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0e8005040 0x7fd0e800b8e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:41.567 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.552+0000 7fd103906700 1 -- 172.21.15.160:0/2598229218 >> 172.21.15.160:0/2598229218 conn(0x7fd0fc0cbb10 msgr2=0x7fd0fc0c7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:41.568 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.552+0000 7fd103906700 1 -- 172.21.15.160:0/2598229218 shutdown_connections 2022-03-21T13:54:41.568 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.552+0000 7fd103906700 1 -- 172.21.15.160:0/2598229218 wait complete. 2022-03-21T13:54:41.568 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.553+0000 7fd103906700 1 Processor -- start 2022-03-21T13:54:41.568 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.553+0000 7fd103906700 1 -- start start 2022-03-21T13:54:41.568 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd103906700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e8005040 0x7fd0fc153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:41.569 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd103906700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0fc150670 0x7fd0fc0bee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:41.569 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd103906700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0fc0bf390 0x7fd0fc168200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:41.569 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd103906700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc165970 con 0x7fd0fc0bf390 2022-03-21T13:54:41.569 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd103906700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0ca650 con 0x7fd0e8005040 2022-03-21T13:54:41.570 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd103906700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0bf820 con 0x7fd0fc150670 2022-03-21T13:54:41.570 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd101ea3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0fc0bf390 0x7fd0fc168200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:41.570 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd101ea3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0fc0bf390 0x7fd0fc168200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56860/0 (socket says 172.21.15.160:56860) 2022-03-21T13:54:41.570 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd101ea3700 1 -- 172.21.15.160:0/673781737 learned_addr learned my addr 172.21.15.160:0/673781737 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:41.570 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd1016a2700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e8005040 0x7fd0fc153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:41.571 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd100ea1700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0fc150670 0x7fd0fc0bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:41.571 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd101ea3700 1 -- 172.21.15.160:0/673781737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0fc150670 msgr2=0x7fd0fc0bee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:41.571 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd101ea3700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0fc150670 0x7fd0fc0bee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:41.571 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd101ea3700 1 -- 172.21.15.160:0/673781737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e8005040 msgr2=0x7fd0fc153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:41.572 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd101ea3700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e8005040 0x7fd0fc153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:41.572 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.554+0000 7fd101ea3700 1 -- 172.21.15.160:0/673781737 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc164cf0 con 0x7fd0fc0bf390 2022-03-21T13:54:41.572 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.555+0000 7fd101ea3700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0fc0bf390 0x7fd0fc168200 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc069ce0 tx=0x7fd0f4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:41.572 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.555+0000 7fd0f97fa700 1 -- 172.21.15.160:0/673781737 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40050d0 con 0x7fd0fc0bf390 2022-03-21T13:54:41.572 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.555+0000 7fd0f97fa700 1 -- 172.21.15.160:0/673781737 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40053a0 con 0x7fd0fc0bf390 2022-03-21T13:54:41.573 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.555+0000 7fd0f97fa700 1 -- 172.21.15.160:0/673781737 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4013dc0 con 0x7fd0fc0bf390 2022-03-21T13:54:41.573 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.555+0000 7fd103906700 1 -- 172.21.15.160:0/673781737 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc164fd0 con 0x7fd0fc0bf390 2022-03-21T13:54:41.573 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.555+0000 7fd103906700 1 -- 172.21.15.160:0/673781737 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc165590 con 0x7fd0fc0bf390 2022-03-21T13:54:41.573 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.556+0000 7fd103906700 1 -- 172.21.15.160:0/673781737 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc070ae0 con 0x7fd0fc0bf390 2022-03-21T13:54:41.574 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.556+0000 7fd0f97fa700 1 -- 172.21.15.160:0/673781737 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fd0f402c070 con 0x7fd0fc0bf390 2022-03-21T13:54:41.574 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.556+0000 7fd0f97fa700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd0dc063d10 0x7fd0dc0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:41.574 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.557+0000 7fd0f97fa700 1 -- 172.21.15.160:0/673781737 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd0f4081780 con 0x7fd0fc0bf390 2022-03-21T13:54:41.574 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.557+0000 7fd1016a2700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd0dc063d10 0x7fd0dc0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:41.574 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.557+0000 7fd1016a2700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd0dc063d10 0x7fd0dc0661c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009fd0 tx=0x7fd0ec00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:41.575 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.561+0000 7fd0f97fa700 1 -- 172.21.15.160:0/673781737 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fd0f4050360 con 0x7fd0fc0bf390 2022-03-21T13:54:41.771 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.769+0000 7fd103906700 1 -- 172.21.15.160:0/673781737 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd0fc0cac40 con 0x7fd0fc0bf390 2022-03-21T13:54:41.771 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.769+0000 7fd0f97fa700 1 -- 172.21.15.160:0/673781737 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+196 (secure 0 0 0) 0x7fd0f402a0e0 con 0x7fd0fc0bf390 2022-03-21T13:54:41.772 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:41.772 INFO:teuthology.orchestra.run.smithi160.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2022-03-21T13:54:41.773 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 -- 172.21.15.160:0/673781737 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd0dc063d10 msgr2=0x7fd0dc0661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:41.773 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd0dc063d10 0x7fd0dc0661c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009fd0 tx=0x7fd0ec00b040 comp rx=0 tx=0).stop 2022-03-21T13:54:41.774 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 -- 172.21.15.160:0/673781737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0fc0bf390 msgr2=0x7fd0fc168200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:41.774 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0fc0bf390 0x7fd0fc168200 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc069ce0 tx=0x7fd0f4014000 comp rx=0 tx=0).stop 2022-03-21T13:54:41.774 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 -- 172.21.15.160:0/673781737 shutdown_connections 2022-03-21T13:54:41.774 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fd0dc063d10 0x7fd0dc0661c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:41.774 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0fc0bf390 0x7fd0fc168200 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:41.775 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e8005040 0x7fd0fc153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:41.775 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 --2- 172.21.15.160:0/673781737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0fc150670 0x7fd0fc0bee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:41.775 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 -- 172.21.15.160:0/673781737 >> 172.21.15.160:0/673781737 conn(0x7fd0fc0cbb10 msgr2=0x7fd0fc14f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:41.775 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 -- 172.21.15.160:0/673781737 shutdown_connections 2022-03-21T13:54:41.776 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:41.771+0000 7fd103906700 1 -- 172.21.15.160:0/673781737 wait complete. 2022-03-21T13:54:44.786 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-03-21T13:54:44.911 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.910+0000 7f02aa5db700 1 Processor -- start 2022-03-21T13:54:44.912 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.910+0000 7f02aa5db700 1 -- start start 2022-03-21T13:54:44.914 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.910+0000 7f02aa5db700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a40c1520 0x7f02a40c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:44.915 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.910+0000 7f02aa5db700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f02a406c500 0x7f02a406c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:44.915 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02aa5db700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a41535d0 con 0x7f02a4151f70 2022-03-21T13:54:44.915 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02aa5db700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a406dd90 con 0x7f02a406c500 2022-03-21T13:54:44.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02aa5db700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4153b00 con 0x7f02a40c1520 2022-03-21T13:54:44.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02a3fff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a40c1520 0x7f02a40c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:44.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02a37fe700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f02a406c500 0x7f02a406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:44.916 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02a3fff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a40c1520 0x7f02a40c18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47260/0 (socket says 172.21.15.160:47260) 2022-03-21T13:54:44.917 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02a3fff700 1 -- 172.21.15.160:0/1397167496 learned_addr learned my addr 172.21.15.160:0/1397167496 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:44.917 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02a8b78700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f02a4151f70 0x7f02a41523d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:53104/0 (socket says 172.21.15.160:53104) 2022-03-21T13:54:44.917 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02a3fff700 1 -- 172.21.15.160:0/1397167496 >> v2:172.21.15.171:3300/0 conn(0x7f02a406c500 msgr2=0x7f02a406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:44.917 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02a3fff700 1 --2- 172.21.15.160:0/1397167496 >> v2:172.21.15.171:3300/0 conn(0x7f02a406c500 0x7f02a406c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:44.917 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02a3fff700 1 -- 172.21.15.160:0/1397167496 >> v1:172.21.15.171:6789/0 conn(0x7f02a4151f70 legacy=0x7f02a41523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:44.918 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02a2ffd700 1 -- 172.21.15.160:0/1397167496 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237662526 0 0) 0x7f02a41535d0 con 0x7f02a4151f70 2022-03-21T13:54:44.918 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02a3fff700 1 -- 172.21.15.160:0/1397167496 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a406c070 con 0x7f02a40c1520 2022-03-21T13:54:44.918 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.911+0000 7f02a37fe700 1 --2- 172.21.15.160:0/1397167496 >> v2:172.21.15.171:3300/0 conn(0x7f02a406c500 0x7f02a406c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:44.918 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02a3fff700 1 --2- 172.21.15.160:0/1397167496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a40c1520 0x7f02a40c18f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0294009810 tx=0x7f0294009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3fc7cfcbaf45df2 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:44.919 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02a2ffd700 1 -- 172.21.15.160:0/1397167496 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294005a90 con 0x7f02a40c1520 2022-03-21T13:54:44.919 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02a2ffd700 1 -- 172.21.15.160:0/1397167496 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294005bf0 con 0x7f02a40c1520 2022-03-21T13:54:44.919 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02a2ffd700 1 -- 172.21.15.160:0/1397167496 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294006030 con 0x7f02a40c1520 2022-03-21T13:54:44.919 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02aa5db700 1 -- 172.21.15.160:0/1397167496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a40c1520 msgr2=0x7f02a40c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:44.919 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02aa5db700 1 --2- 172.21.15.160:0/1397167496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a40c1520 0x7f02a40c18f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0294009810 tx=0x7f0294009060 comp rx=0 tx=0).stop 2022-03-21T13:54:44.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02aa5db700 1 -- 172.21.15.160:0/1397167496 shutdown_connections 2022-03-21T13:54:44.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02aa5db700 1 --2- 172.21.15.160:0/1397167496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a40c1520 0x7f02a40c18f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:44.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02aa5db700 1 --2- 172.21.15.160:0/1397167496 >> v2:172.21.15.171:3300/0 conn(0x7f02a406c500 0x7f02a406c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:44.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02aa5db700 1 -- 172.21.15.160:0/1397167496 >> 172.21.15.160:0/1397167496 conn(0x7f02a40c87e0 msgr2=0x7f02a40c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:44.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02aa5db700 1 -- 172.21.15.160:0/1397167496 shutdown_connections 2022-03-21T13:54:44.921 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.912+0000 7f02aa5db700 1 -- 172.21.15.160:0/1397167496 wait complete. 2022-03-21T13:54:44.923 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.913+0000 7f02aa5db700 1 Processor -- start 2022-03-21T13:54:44.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.914+0000 7f02aa5db700 1 -- start start 2022-03-21T13:54:44.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.914+0000 7f02aa5db700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a406c500 0x7f02a40a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:44.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.914+0000 7f02aa5db700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a40c1520 0x7f02a414eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:44.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.914+0000 7f02aa5db700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a4151f70 0x7f02a40c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:44.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.914+0000 7f02aa5db700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40a44e0 con 0x7f02a4151f70 2022-03-21T13:54:44.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.914+0000 7f02aa5db700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40ad850 con 0x7f02a40c1520 2022-03-21T13:54:44.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.914+0000 7f02aa5db700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40a46f0 con 0x7f02a406c500 2022-03-21T13:54:44.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.914+0000 7f02a8b78700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a4151f70 0x7f02a40c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:44.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.914+0000 7f02a8b78700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a4151f70 0x7f02a40c25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56872/0 (socket says 172.21.15.160:56872) 2022-03-21T13:54:44.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.914+0000 7f02a8b78700 1 -- 172.21.15.160:0/472236971 learned_addr learned my addr 172.21.15.160:0/472236971 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:44.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f02a3fff700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a406c500 0x7f02a40a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:44.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f02a37fe700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a40c1520 0x7f02a414eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:44.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f02a8b78700 1 -- 172.21.15.160:0/472236971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a406c500 msgr2=0x7f02a40a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:44.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f02a8b78700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a406c500 0x7f02a40a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:44.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f02a8b78700 1 -- 172.21.15.160:0/472236971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a40c1520 msgr2=0x7f02a414eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:44.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f02a8b78700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a40c1520 0x7f02a414eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:44.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f02a8b78700 1 -- 172.21.15.160:0/472236971 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02980092a0 con 0x7f02a4151f70 2022-03-21T13:54:44.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f02a8b78700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a4151f70 0x7f02a40c25e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c760 tx=0x7f029c007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:44.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f028bfff700 1 -- 172.21.15.160:0/472236971 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c004c40 con 0x7f02a4151f70 2022-03-21T13:54:44.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f028bfff700 1 -- 172.21.15.160:0/472236971 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c004dc0 con 0x7f02a4151f70 2022-03-21T13:54:44.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f02aa5db700 1 -- 172.21.15.160:0/472236971 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0294009300 con 0x7f02a4151f70 2022-03-21T13:54:44.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f028bfff700 1 -- 172.21.15.160:0/472236971 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c0073a0 con 0x7f02a4151f70 2022-03-21T13:54:44.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.915+0000 7f02aa5db700 1 -- 172.21.15.160:0/472236971 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a40a4cb0 con 0x7f02a4151f70 2022-03-21T13:54:44.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.916+0000 7f02aa5db700 1 -- 172.21.15.160:0/472236971 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a405dc80 con 0x7f02a4151f70 2022-03-21T13:54:44.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.916+0000 7f028bfff700 1 -- 172.21.15.160:0/472236971 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f029c010030 con 0x7f02a4151f70 2022-03-21T13:54:44.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.917+0000 7f028bfff700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0284063d10 0x7f02840661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:44.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.917+0000 7f028bfff700 1 -- 172.21.15.160:0/472236971 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f029c080510 con 0x7f02a4151f70 2022-03-21T13:54:44.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.917+0000 7f02a3fff700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0284063d10 0x7f02840661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:44.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.917+0000 7f02a3fff700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0284063d10 0x7f02840661c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0294009810 tx=0x7f0294016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:44.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:44.921+0000 7f028bfff700 1 -- 172.21.15.160:0/472236971 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f029c04f170 con 0x7f02a4151f70 2022-03-21T13:54:45.131 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.130+0000 7f02aa5db700 1 -- 172.21.15.160:0/472236971 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f02a406fc00 con 0x7f02a4151f70 2022-03-21T13:54:45.132 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.130+0000 7f028bfff700 1 -- 172.21.15.160:0/472236971 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+196 (secure 0 0 0) 0x7f029c052790 con 0x7f02a4151f70 2022-03-21T13:54:45.132 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:45.133 INFO:teuthology.orchestra.run.smithi160.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2022-03-21T13:54:45.134 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 -- 172.21.15.160:0/472236971 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0284063d10 msgr2=0x7f02840661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:45.134 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0284063d10 0x7f02840661c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0294009810 tx=0x7f0294016000 comp rx=0 tx=0).stop 2022-03-21T13:54:45.135 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 -- 172.21.15.160:0/472236971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a4151f70 msgr2=0x7f02a40c25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:45.135 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a4151f70 0x7f02a40c25e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c760 tx=0x7f029c007f10 comp rx=0 tx=0).stop 2022-03-21T13:54:45.135 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 -- 172.21.15.160:0/472236971 shutdown_connections 2022-03-21T13:54:45.135 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f0284063d10 0x7f02840661c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:45.136 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a4151f70 0x7f02a40c25e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:45.136 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a406c500 0x7f02a40a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:45.136 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 --2- 172.21.15.160:0/472236971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a40c1520 0x7f02a414eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:45.136 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 -- 172.21.15.160:0/472236971 >> 172.21.15.160:0/472236971 conn(0x7f02a40c87e0 msgr2=0x7f02a41523d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:45.136 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 -- 172.21.15.160:0/472236971 shutdown_connections 2022-03-21T13:54:45.137 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:45.132+0000 7f02aa5db700 1 -- 172.21.15.160:0/472236971 wait complete. 2022-03-21T13:54:48.146 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-03-21T13:54:48.273 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.271+0000 7f13eb59e700 1 Processor -- start 2022-03-21T13:54:48.273 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.271+0000 7f13eb59e700 1 -- start start 2022-03-21T13:54:48.275 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13eb59e700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f13ec06c1c0 0x7f13ec0c0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:48.275 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13eb59e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f13ec14ce20 0x7f13ec0c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:48.275 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13eb59e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ec06d910 con 0x7f13ec14ca50 2022-03-21T13:54:48.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13eb59e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec0c4f50 con 0x7f13ec14ce20 2022-03-21T13:54:48.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13eb59e700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec06ded0 con 0x7f13ec06c1c0 2022-03-21T13:54:48.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13ead9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f13ec14ce20 0x7f13ec0c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:48.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13ea59c700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f13ec14ca50 0x7f13ec06cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:60028/0 (socket says 172.21.15.160:60028) 2022-03-21T13:54:48.276 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13ea59c700 1 -- 172.21.15.160:0/3620905181 learned_addr learned my addr 172.21.15.160:0/3620905181 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:48.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13e9d9b700 1 --2- 172.21.15.160:0/3620905181 >> v2:172.21.15.171:3300/0 conn(0x7f13ec06c1c0 0x7f13ec0c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:48.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13ead9d700 1 -- 172.21.15.160:0/3620905181 >> v2:172.21.15.171:3300/0 conn(0x7f13ec06c1c0 msgr2=0x7f13ec0c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:48.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13ead9d700 1 --2- 172.21.15.160:0/3620905181 >> v2:172.21.15.171:3300/0 conn(0x7f13ec06c1c0 0x7f13ec0c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:48.277 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.272+0000 7f13ead9d700 1 -- 172.21.15.160:0/3620905181 >> v1:172.21.15.160:6789/0 conn(0x7f13ec14ca50 legacy=0x7f13ec06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:48.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.273+0000 7f13ead9d700 1 -- 172.21.15.160:0/3620905181 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec0c2b80 con 0x7f13ec14ce20 2022-03-21T13:54:48.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.273+0000 7f13e959a700 1 -- 172.21.15.160:0/3620905181 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53545454 0 0) 0x7f13ec06d910 con 0x7f13ec14ca50 2022-03-21T13:54:48.278 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.273+0000 7f13ead9d700 1 --2- 172.21.15.160:0/3620905181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13ec14ce20 0x7f13ec0c08d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0c6430 tx=0x7f13e4009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b888630aa21e0ca8 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:48.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.274+0000 7f13e959a700 1 -- 172.21.15.160:0/3620905181 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e4011630 con 0x7f13ec14ce20 2022-03-21T13:54:48.282 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.275+0000 7f13e959a700 1 -- 172.21.15.160:0/3620905181 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e4011790 con 0x7f13ec14ce20 2022-03-21T13:54:48.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.275+0000 7f13e959a700 1 -- 172.21.15.160:0/3620905181 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e4011b30 con 0x7f13ec14ce20 2022-03-21T13:54:48.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.275+0000 7f13eb59e700 1 -- 172.21.15.160:0/3620905181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13ec14ce20 msgr2=0x7f13ec0c08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:48.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.275+0000 7f13eb59e700 1 --2- 172.21.15.160:0/3620905181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13ec14ce20 0x7f13ec0c08d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0c6430 tx=0x7f13e4009060 comp rx=0 tx=0).stop 2022-03-21T13:54:48.283 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.275+0000 7f13eb59e700 1 -- 172.21.15.160:0/3620905181 shutdown_connections 2022-03-21T13:54:48.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.275+0000 7f13eb59e700 1 --2- 172.21.15.160:0/3620905181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13ec14ce20 0x7f13ec0c08d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:48.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.275+0000 7f13eb59e700 1 --2- 172.21.15.160:0/3620905181 >> v2:172.21.15.171:3300/0 conn(0x7f13ec06c1c0 0x7f13ec0c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:48.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.275+0000 7f13eb59e700 1 -- 172.21.15.160:0/3620905181 >> 172.21.15.160:0/3620905181 conn(0x7f13ec0c9710 msgr2=0x7f13ec0c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:48.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.275+0000 7f13eb59e700 1 -- 172.21.15.160:0/3620905181 shutdown_connections 2022-03-21T13:54:48.284 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.275+0000 7f13eb59e700 1 -- 172.21.15.160:0/3620905181 wait complete. 2022-03-21T13:54:48.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.276+0000 7f13eb59e700 1 Processor -- start 2022-03-21T13:54:48.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.276+0000 7f13eb59e700 1 -- start start 2022-03-21T13:54:48.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13eb59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13ec06c1c0 0x7f13ec150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:48.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13eb59e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13ec14ca50 0x7f13ec151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:48.285 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13eb59e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13ec14ce20 0x7f13ec149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:48.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13eb59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec0bfa20 con 0x7f13ec06c1c0 2022-03-21T13:54:48.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13eb59e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec0bf4f0 con 0x7f13ec14ca50 2022-03-21T13:54:48.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13eb59e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec0bf740 con 0x7f13ec14ce20 2022-03-21T13:54:48.286 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13ea59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13ec06c1c0 0x7f13ec150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:48.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13ea59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13ec06c1c0 0x7f13ec150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56882/0 (socket says 172.21.15.160:56882) 2022-03-21T13:54:48.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13ea59c700 1 -- 172.21.15.160:0/475178008 learned_addr learned my addr 172.21.15.160:0/475178008 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:48.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13e9d9b700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13ec14ca50 0x7f13ec151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:48.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13ead9d700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13ec14ce20 0x7f13ec149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:48.287 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13ea59c700 1 -- 172.21.15.160:0/475178008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13ec14ce20 msgr2=0x7f13ec149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:48.288 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13ea59c700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13ec14ce20 0x7f13ec149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:48.288 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13ea59c700 1 -- 172.21.15.160:0/475178008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13ec14ca50 msgr2=0x7f13ec151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:48.288 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13ea59c700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13ec14ca50 0x7f13ec151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:48.288 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13ea59c700 1 -- 172.21.15.160:0/475178008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e40092a0 con 0x7f13ec06c1c0 2022-03-21T13:54:48.288 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.277+0000 7f13ead9d700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13ec14ce20 0x7f13ec149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:48.289 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.278+0000 7f13ea59c700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13ec06c1c0 0x7f13ec150b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c870 tx=0x7f13dc007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:48.289 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.278+0000 7f13e27fc700 1 -- 172.21.15.160:0/475178008 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc005c00 con 0x7f13ec06c1c0 2022-03-21T13:54:48.289 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.278+0000 7f13e27fc700 1 -- 172.21.15.160:0/475178008 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc005d80 con 0x7f13ec06c1c0 2022-03-21T13:54:48.289 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.278+0000 7f13e27fc700 1 -- 172.21.15.160:0/475178008 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc007340 con 0x7f13ec06c1c0 2022-03-21T13:54:48.289 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.278+0000 7f13eb59e700 1 -- 172.21.15.160:0/475178008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ec152d50 con 0x7f13ec06c1c0 2022-03-21T13:54:48.290 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.278+0000 7f13eb59e700 1 -- 172.21.15.160:0/475178008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ec0c7050 con 0x7f13ec06c1c0 2022-03-21T13:54:48.290 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.279+0000 7f13eb59e700 1 -- 172.21.15.160:0/475178008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ec06fec0 con 0x7f13ec06c1c0 2022-03-21T13:54:48.290 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.279+0000 7f13e27fc700 1 -- 172.21.15.160:0/475178008 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f13dc010070 con 0x7f13ec06c1c0 2022-03-21T13:54:48.290 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.279+0000 7f13e27fc700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f13d0063ce0 0x7f13d0066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:48.291 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.280+0000 7f13e27fc700 1 -- 172.21.15.160:0/475178008 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13dc0803b0 con 0x7f13ec06c1c0 2022-03-21T13:54:48.291 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.280+0000 7f13e9d9b700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f13d0063ce0 0x7f13d0066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:48.291 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.280+0000 7f13e9d9b700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f13d0063ce0 0x7f13d0066190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13ec06adf0 tx=0x7f13d4009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:48.292 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.284+0000 7f13e27fc700 1 -- 172.21.15.160:0/475178008 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f13dc04f010 con 0x7f13ec06c1c0 2022-03-21T13:54:48.496 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.494+0000 7f13eb59e700 1 -- 172.21.15.160:0/475178008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f13ec04b760 con 0x7f13ec06c1c0 2022-03-21T13:54:48.497 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.495+0000 7f13e27fc700 1 -- 172.21.15.160:0/475178008 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+196 (secure 0 0 0) 0x7f13dc052630 con 0x7f13ec06c1c0 2022-03-21T13:54:48.497 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:48.497 INFO:teuthology.orchestra.run.smithi160.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2022-03-21T13:54:48.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 -- 172.21.15.160:0/475178008 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f13d0063ce0 msgr2=0x7f13d0066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:48.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f13d0063ce0 0x7f13d0066190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13ec06adf0 tx=0x7f13d4009060 comp rx=0 tx=0).stop 2022-03-21T13:54:48.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 -- 172.21.15.160:0/475178008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13ec06c1c0 msgr2=0x7f13ec150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:48.500 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13ec06c1c0 0x7f13ec150b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c870 tx=0x7f13dc007e80 comp rx=0 tx=0).stop 2022-03-21T13:54:48.500 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 -- 172.21.15.160:0/475178008 shutdown_connections 2022-03-21T13:54:48.500 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f13d0063ce0 0x7f13d0066190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:48.500 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13ec14ce20 0x7f13ec149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:48.501 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13ec06c1c0 0x7f13ec150b30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:48.501 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 --2- 172.21.15.160:0/475178008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13ec14ca50 0x7f13ec151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:48.501 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 -- 172.21.15.160:0/475178008 >> 172.21.15.160:0/475178008 conn(0x7f13ec0c9710 msgr2=0x7f13ec14c290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:48.501 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 -- 172.21.15.160:0/475178008 shutdown_connections 2022-03-21T13:54:48.502 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:48.497+0000 7f13eb59e700 1 -- 172.21.15.160:0/475178008 wait complete. 2022-03-21T13:54:51.511 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-03-21T13:54:51.639 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.637+0000 7f88bb42e700 1 Processor -- start 2022-03-21T13:54:51.639 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.637+0000 7f88bb42e700 1 -- start start 2022-03-21T13:54:51.643 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.638+0000 7f88bb42e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b414c810 0x7f88b406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:51.643 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.638+0000 7f88bb42e700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f88b414cbe0 0x7f88b40c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:51.643 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.638+0000 7f88bb42e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b406e5a0 con 0x7f88b406e120 2022-03-21T13:54:51.644 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.638+0000 7f88bb42e700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b406c650 con 0x7f88b414cbe0 2022-03-21T13:54:51.644 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.638+0000 7f88bb42e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b406d080 con 0x7f88b414c810 2022-03-21T13:54:51.644 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.638+0000 7f88b99cb700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f88b406e120 0x7f88b40c2680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:60056/0 (socket says 172.21.15.160:60056) 2022-03-21T13:54:51.644 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.638+0000 7f88b99cb700 1 -- 172.21.15.160:0/531774346 learned_addr learned my addr 172.21.15.160:0/531774346 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:51.645 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b91ca700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b414c810 0x7f88b406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:51.645 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b89c9700 1 --2- 172.21.15.160:0/531774346 >> v2:172.21.15.171:3300/0 conn(0x7f88b414cbe0 0x7f88b40c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:51.645 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327980708 0 0) 0x7f88b406e5a0 con 0x7f88b406e120 2022-03-21T13:54:51.645 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88a00033f0 con 0x7f88b406e120 2022-03-21T13:54:51.645 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4100308628 0 0) 0x7f88a00033f0 con 0x7f88b406e120 2022-03-21T13:54:51.646 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b414c810 msgr2=0x7f88b406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:51.646 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b414c810 0x7f88b406c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:51.646 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 >> v2:172.21.15.171:3300/0 conn(0x7f88b414cbe0 msgr2=0x7f88b40c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:51.646 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 --2- 172.21.15.160:0/531774346 >> v2:172.21.15.171:3300/0 conn(0x7f88b414cbe0 0x7f88b40c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:51.646 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b406d360 con 0x7f88b406e120 2022-03-21T13:54:51.647 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7f88ac001470 con 0x7f88b406e120 2022-03-21T13:54:51.647 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 >> v1:172.21.15.160:6789/0 conn(0x7f88b406e120 legacy=0x7f88b40c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:51.647 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88a00038e0 0x7f88a0003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:51.647 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b414c810 0x7f88a0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:51.647 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88a0004bd0 0x7f88a0005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:51.648 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b406c650 con 0x7f88a0004bd0 2022-03-21T13:54:51.648 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b406d080 con 0x7f88a00038e0 2022-03-21T13:54:51.648 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a000b8e0 con 0x7f88b414c810 2022-03-21T13:54:51.648 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b99cb700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88a0004bd0 0x7f88a0005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:51.649 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b91ca700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88a00038e0 0x7f88a0003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:51.649 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b89c9700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b414c810 0x7f88a0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:51.649 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b99cb700 1 -- 172.21.15.160:0/531774346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b414c810 msgr2=0x7f88a0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:51.649 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b99cb700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b414c810 0x7f88a0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:51.649 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b99cb700 1 -- 172.21.15.160:0/531774346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88a00038e0 msgr2=0x7f88a0003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:51.650 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b99cb700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88a00038e0 0x7f88a0003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:51.650 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b99cb700 1 -- 172.21.15.160:0/531774346 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a00033f0 con 0x7f88a0004bd0 2022-03-21T13:54:51.650 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.639+0000 7f88b99cb700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88a0004bd0 0x7f88a0005040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00c210 tx=0x7f88ac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4568ce5ab1e54374 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:51.650 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.640+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac00ca80 con 0x7f88a0004bd0 2022-03-21T13:54:51.651 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.640+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac00cc00 con 0x7f88a0004bd0 2022-03-21T13:54:51.651 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.640+0000 7f88b3fff700 1 -- 172.21.15.160:0/531774346 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0070d0 con 0x7f88a0004bd0 2022-03-21T13:54:51.651 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.640+0000 7f88bb42e700 1 -- 172.21.15.160:0/531774346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88a0004bd0 msgr2=0x7f88a0005040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:51.651 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.640+0000 7f88bb42e700 1 --2- 172.21.15.160:0/531774346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88a0004bd0 0x7f88a0005040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00c210 tx=0x7f88ac001e70 comp rx=0 tx=0).stop 2022-03-21T13:54:51.651 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.640+0000 7f88b99cb700 1 -- 172.21.15.160:0/531774346 reap_dead start 2022-03-21T13:54:51.652 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.640+0000 7f88bb42e700 1 -- 172.21.15.160:0/531774346 shutdown_connections 2022-03-21T13:54:51.652 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.640+0000 7f88bb42e700 1 -- 172.21.15.160:0/531774346 >> 172.21.15.160:0/531774346 conn(0x7f88b40c9930 msgr2=0x7f88b40c5900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:51.652 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.640+0000 7f88bb42e700 1 -- 172.21.15.160:0/531774346 shutdown_connections 2022-03-21T13:54:51.652 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.640+0000 7f88bb42e700 1 -- 172.21.15.160:0/531774346 wait complete. 2022-03-21T13:54:51.653 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.641+0000 7f88bb42e700 1 Processor -- start 2022-03-21T13:54:51.653 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.641+0000 7f88bb42e700 1 -- start start 2022-03-21T13:54:51.656 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.642+0000 7f88bb42e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b4144490 0x7f88b4149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:51.656 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.642+0000 7f88bb42e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b4148670 0x7f88b414a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:51.656 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.642+0000 7f88bb42e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88b414aca0 0x7f88b4153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:51.656 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.642+0000 7f88bb42e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4147c20 con 0x7f88b4148670 2022-03-21T13:54:51.657 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.642+0000 7f88bb42e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b41481e0 con 0x7f88b414aca0 2022-03-21T13:54:51.657 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.642+0000 7f88bb42e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b414b340 con 0x7f88b4144490 2022-03-21T13:54:51.657 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.642+0000 7f88b89c9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b4148670 0x7f88b414a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:51.657 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.642+0000 7f88b89c9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b4148670 0x7f88b414a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56916/0 (socket says 172.21.15.160:56916) 2022-03-21T13:54:51.658 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.642+0000 7f88b89c9700 1 -- 172.21.15.160:0/620145519 learned_addr learned my addr 172.21.15.160:0/620145519 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:51.658 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.642+0000 7f88b91ca700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b4144490 0x7f88b4149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:51.658 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.642+0000 7f88b99cb700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88b414aca0 0x7f88b4153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:51.658 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.643+0000 7f88b89c9700 1 -- 172.21.15.160:0/620145519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b4144490 msgr2=0x7f88b4149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:51.658 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.643+0000 7f88b89c9700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b4144490 0x7f88b4149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:51.659 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.643+0000 7f88b89c9700 1 -- 172.21.15.160:0/620145519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88b414aca0 msgr2=0x7f88b4153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:51.659 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.643+0000 7f88b89c9700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88b414aca0 0x7f88b4153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:51.659 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.643+0000 7f88b89c9700 1 -- 172.21.15.160:0/620145519 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b414b5b0 con 0x7f88b4148670 2022-03-21T13:54:51.659 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.643+0000 7f88b89c9700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b4148670 0x7f88b414a400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f88a8003c40 tx=0x7f88a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:51.659 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.643+0000 7f88b17fa700 1 -- 172.21.15.160:0/620145519 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a80168c0 con 0x7f88b4148670 2022-03-21T13:54:51.660 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.643+0000 7f88b17fa700 1 -- 172.21.15.160:0/620145519 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a8015040 con 0x7f88b4148670 2022-03-21T13:54:51.660 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.643+0000 7f88bb42e700 1 -- 172.21.15.160:0/620145519 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b414b890 con 0x7f88b4148670 2022-03-21T13:54:51.660 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.643+0000 7f88b17fa700 1 -- 172.21.15.160:0/620145519 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8016c50 con 0x7f88b4148670 2022-03-21T13:54:51.660 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.643+0000 7f88bb42e700 1 -- 172.21.15.160:0/620145519 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b4149860 con 0x7f88b4148670 2022-03-21T13:54:51.660 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.644+0000 7f88bb42e700 1 -- 172.21.15.160:0/620145519 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b406fc00 con 0x7f88b4148670 2022-03-21T13:54:51.661 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.644+0000 7f88b17fa700 1 -- 172.21.15.160:0/620145519 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f88a801b440 con 0x7f88b4148670 2022-03-21T13:54:51.661 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.645+0000 7f88b17fa700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f8894063d10 0x7f88940661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:51.661 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.645+0000 7f88b17fa700 1 -- 172.21.15.160:0/620145519 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f88a8084bc0 con 0x7f88b4148670 2022-03-21T13:54:51.661 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.645+0000 7f88b91ca700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f8894063d10 0x7f88940661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:51.661 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.645+0000 7f88b91ca700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f8894063d10 0x7f88940661c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88a40094d0 tx=0x7f88a400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:51.662 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.649+0000 7f88b17fa700 1 -- 172.21.15.160:0/620145519 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f88a8053650 con 0x7f88b4148670 2022-03-21T13:54:51.861 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.859+0000 7f88bb42e700 1 -- 172.21.15.160:0/620145519 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f88b406d640 con 0x7f88b4148670 2022-03-21T13:54:51.861 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.859+0000 7f88b17fa700 1 -- 172.21.15.160:0/620145519 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f88a8056c70 con 0x7f88b4148670 2022-03-21T13:54:51.861 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:51.862 INFO:teuthology.orchestra.run.smithi160.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-03-21T13:54:51.863 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 -- 172.21.15.160:0/620145519 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f8894063d10 msgr2=0x7f88940661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:51.863 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f8894063d10 0x7f88940661c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88a40094d0 tx=0x7f88a400b040 comp rx=0 tx=0).stop 2022-03-21T13:54:51.863 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 -- 172.21.15.160:0/620145519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b4148670 msgr2=0x7f88b414a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:51.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b4148670 0x7f88b414a400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f88a8003c40 tx=0x7f88a8008040 comp rx=0 tx=0).stop 2022-03-21T13:54:51.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 -- 172.21.15.160:0/620145519 shutdown_connections 2022-03-21T13:54:51.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f8894063d10 0x7f88940661c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:51.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88b414aca0 0x7f88b4153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:51.864 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88b4144490 0x7f88b4149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:51.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 --2- 172.21.15.160:0/620145519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b4148670 0x7f88b414a400 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:51.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 -- 172.21.15.160:0/620145519 >> 172.21.15.160:0/620145519 conn(0x7f88b40c9930 msgr2=0x7f88b4152c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:51.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 -- 172.21.15.160:0/620145519 shutdown_connections 2022-03-21T13:54:51.865 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.861+0000 7f88bb42e700 1 -- 172.21.15.160:0/620145519 wait complete. 2022-03-21T13:54:51.874 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-03-21T13:54:51.875 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-21T13:54:51.989 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.987+0000 7fbefdce9700 1 Processor -- start 2022-03-21T13:54:51.989 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.987+0000 7fbefdce9700 1 -- start start 2022-03-21T13:54:51.992 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbefdce9700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806c1c0 0x7fbef80c0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:51.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbefdce9700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef806d910 con 0x7fbef814ce20 2022-03-21T13:54:51.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbefdce9700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef806ded0 con 0x7fbef814ca50 2022-03-21T13:54:51.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbefdce9700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80c4f50 con 0x7fbef806c1c0 2022-03-21T13:54:51.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbefd4e8700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fbef814ce20 0x7fbef815d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:60078/0 (socket says 172.21.15.160:60078) 2022-03-21T13:54:51.993 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbefd4e8700 1 -- 172.21.15.160:0/1289959102 learned_addr learned my addr 172.21.15.160:0/1289959102 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:51.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbef7fff700 1 --2- 172.21.15.160:0/1289959102 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806c1c0 0x7fbef80c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:51.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbef77fe700 1 -- 172.21.15.160:0/1289959102 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108351173 0 0) 0x7fbef806d910 con 0x7fbef814ce20 2022-03-21T13:54:51.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbef77fe700 1 -- 172.21.15.160:0/1289959102 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee40033f0 con 0x7fbef814ce20 2022-03-21T13:54:51.994 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbef77fe700 1 -- 172.21.15.160:0/1289959102 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737869787 0 0) 0x7fbef806ded0 con 0x7fbef814ca50 2022-03-21T13:54:51.995 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbef77fe700 1 -- 172.21.15.160:0/1289959102 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbef806d910 con 0x7fbef814ca50 2022-03-21T13:54:51.995 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbef7fff700 1 -- 172.21.15.160:0/1289959102 >> v1:172.21.15.171:6789/0 conn(0x7fbef814ca50 legacy=0x7fbef806cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:51.995 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbef7fff700 1 -- 172.21.15.160:0/1289959102 >> v1:172.21.15.160:6789/0 conn(0x7fbef814ce20 legacy=0x7fbef815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:51.995 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.988+0000 7fbef77fe700 1 -- 172.21.15.160:0/1289959102 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1056030781 0 0) 0x7fbee40033f0 con 0x7fbef814ce20 2022-03-21T13:54:51.996 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbef7fff700 1 -- 172.21.15.160:0/1289959102 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80c2b80 con 0x7fbef806c1c0 2022-03-21T13:54:51.996 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbef7fff700 1 --2- 172.21.15.160:0/1289959102 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806c1c0 0x7fbef80c0390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009790 tx=0x7fbeec009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3748f2d14f582111 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:51.996 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbef77fe700 1 -- 172.21.15.160:0/1289959102 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00017f0 con 0x7fbef806c1c0 2022-03-21T13:54:51.996 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbef77fe700 1 -- 172.21.15.160:0/1289959102 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec004030 con 0x7fbef806c1c0 2022-03-21T13:54:51.996 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbef77fe700 1 -- 172.21.15.160:0/1289959102 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0043b0 con 0x7fbef806c1c0 2022-03-21T13:54:51.997 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbefdce9700 1 -- 172.21.15.160:0/1289959102 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806c1c0 msgr2=0x7fbef80c0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:51.997 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbefdce9700 1 --2- 172.21.15.160:0/1289959102 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806c1c0 0x7fbef80c0390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009790 tx=0x7fbeec009060 comp rx=0 tx=0).stop 2022-03-21T13:54:51.997 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbefdce9700 1 -- 172.21.15.160:0/1289959102 shutdown_connections 2022-03-21T13:54:51.997 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbefdce9700 1 --2- 172.21.15.160:0/1289959102 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806c1c0 0x7fbef80c0390 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:51.997 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbefdce9700 1 -- 172.21.15.160:0/1289959102 >> 172.21.15.160:0/1289959102 conn(0x7fbef80c9710 msgr2=0x7fbef80c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:51.998 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbefdce9700 1 -- 172.21.15.160:0/1289959102 shutdown_connections 2022-03-21T13:54:51.998 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.989+0000 7fbefdce9700 1 -- 172.21.15.160:0/1289959102 wait complete. 2022-03-21T13:54:51.998 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.990+0000 7fbefdce9700 1 Processor -- start 2022-03-21T13:54:51.998 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.991+0000 7fbefdce9700 1 -- start start 2022-03-21T13:54:52.001 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.991+0000 7fbefdce9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbef806c1c0 0x7fbef80bcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.001 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.991+0000 7fbefdce9700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef814ca50 0x7fbef80be580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.001 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.991+0000 7fbefdce9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbef814ce20 0x7fbef80c0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.001 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.991+0000 7fbefdce9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80befe0 con 0x7fbef814ce20 2022-03-21T13:54:52.002 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.991+0000 7fbefdce9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef814f450 con 0x7fbef806c1c0 2022-03-21T13:54:52.002 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.991+0000 7fbefdce9700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef814fc60 con 0x7fbef814ca50 2022-03-21T13:54:52.002 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.991+0000 7fbefd4e8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbef814ce20 0x7fbef80c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.002 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.991+0000 7fbefd4e8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbef814ce20 0x7fbef80c0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56932/0 (socket says 172.21.15.160:56932) 2022-03-21T13:54:52.003 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.991+0000 7fbefd4e8700 1 -- 172.21.15.160:0/706677834 learned_addr learned my addr 172.21.15.160:0/706677834 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:52.003 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbefcce7700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbef806c1c0 0x7fbef80bcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.003 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbef7fff700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef814ca50 0x7fbef80be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.003 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbefd4e8700 1 -- 172.21.15.160:0/706677834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef814ca50 msgr2=0x7fbef80be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.003 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbefd4e8700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef814ca50 0x7fbef80be580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.004 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbefd4e8700 1 -- 172.21.15.160:0/706677834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbef806c1c0 msgr2=0x7fbef80bcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.004 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbefd4e8700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbef806c1c0 0x7fbef80bcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.004 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbefd4e8700 1 -- 172.21.15.160:0/706677834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec0092a0 con 0x7fbef814ce20 2022-03-21T13:54:52.004 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbefcce7700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbef806c1c0 0x7fbef80bcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:52.005 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbefd4e8700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbef814ce20 0x7fbef80c0150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbef000cb90 tx=0x7fbef0001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:52.005 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbef4ff9700 1 -- 172.21.15.160:0/706677834 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0004c40 con 0x7fbef814ce20 2022-03-21T13:54:52.005 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbef4ff9700 1 -- 172.21.15.160:0/706677834 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef0004da0 con 0x7fbef814ce20 2022-03-21T13:54:52.005 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbefdce9700 1 -- 172.21.15.160:0/706677834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef81633b0 con 0x7fbef814ce20 2022-03-21T13:54:52.005 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbef4ff9700 1 -- 172.21.15.160:0/706677834 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00073a0 con 0x7fbef814ce20 2022-03-21T13:54:52.006 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.992+0000 7fbefdce9700 1 -- 172.21.15.160:0/706677834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef8163650 con 0x7fbef814ce20 2022-03-21T13:54:52.006 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.993+0000 7fbefdce9700 1 -- 172.21.15.160:0/706677834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef814f590 con 0x7fbef814ce20 2022-03-21T13:54:52.006 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.994+0000 7fbef4ff9700 1 -- 172.21.15.160:0/706677834 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fbef001a030 con 0x7fbef814ce20 2022-03-21T13:54:52.006 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.994+0000 7fbef4ff9700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fbed8063ce0 0x7fbed8066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.007 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.994+0000 7fbef4ff9700 1 -- 172.21.15.160:0/706677834 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbef00801c0 con 0x7fbef814ce20 2022-03-21T13:54:52.007 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.994+0000 7fbefcce7700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fbed8063ce0 0x7fbed8066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.007 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.994+0000 7fbefcce7700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fbed8063ce0 0x7fbed8066190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbee80018a0 tx=0x7fbee8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:52.007 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:51.998+0000 7fbef4ff9700 1 -- 172.21.15.160:0/706677834 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fbef004eec0 con 0x7fbef814ce20 2022-03-21T13:54:52.173 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.171+0000 7fbefdce9700 1 -- 172.21.15.160:0/706677834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbef814f590 con 0x7fbef814ce20 2022-03-21T13:54:52.174 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.172+0000 7fbef4ff9700 1 -- 172.21.15.160:0/706677834 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16893 (secure 0 0 0) 0x7fbef814f590 con 0x7fbef814ce20 2022-03-21T13:54:52.174 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:52.174 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":20,"fsid":"b2a3ddc8-064e-4cc9-8187-33ea19afd50a","created":"2022-03-21T13:54:10.384226+0000","modified":"2022-03-21T13:54:28.535055+0000","last_up_change":"2022-03-21T13:54:20.412036+0000","last_in_change":"2022-03-21T13:54:12.760084+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-03-21T13:54:21.458770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-03-21T13:54:21.499620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-21T13:54:25.482900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-21T13:54:26.501704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"828ac39d-86ad-44a1-bb66-c99786642970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":25441},{"type":"v1","addr":"172.21.15.160:6810","nonce":25441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":25441},{"type":"v1","addr":"172.21.15.160:6814","nonce":25441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":25441},{"type":"v1","addr":"172.21.15.160:6822","nonce":25441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":25441},{"type":"v1","addr":"172.21.15.160:6818","nonce":25441}]},"public_addr":"172.21.15.160:6810/25441","cluster_addr":"172.21.15.160:6814/25441","heartbeat_back_addr":"172.21.15.160:6822/25441","heartbeat_front_addr":"172.21.15.160:6818/25441","state":["exists","up"]},{"osd":1,"uuid":"464764e2-a47e-43c0-8c93-b6bfd10ba526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":25442},{"type":"v1","addr":"172.21.15.160:6825","nonce":25442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":25442},{"type":"v1","addr":"172.21.15.160:6827","nonce":25442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":25442},{"type":"v1","addr":"172.21.15.160:6831","nonce":25442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":25442},{"type":"v1","addr":"172.21.15.160:6829","nonce":25442}]},"public_addr":"172.21.15.160:6825/25442","cluster_addr":"172.21.15.160:6827/25442","heartbeat_back_addr":"172.21.15.160:6831/25442","heartbeat_front_addr":"172.21.15.160:6829/25442","state":["exists","up"]},{"osd":2,"uuid":"4dbfea57-14b6-4c67-8312-fc7d71ef77a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":25443},{"type":"v1","addr":"172.21.15.160:6811","nonce":25443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6813","nonce":25443},{"type":"v1","addr":"172.21.15.160:6815","nonce":25443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":25443},{"type":"v1","addr":"172.21.15.160:6823","nonce":25443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":25443},{"type":"v1","addr":"172.21.15.160:6819","nonce":25443}]},"public_addr":"172.21.15.160:6811/25443","cluster_addr":"172.21.15.160:6815/25443","heartbeat_back_addr":"172.21.15.160:6823/25443","heartbeat_front_addr":"172.21.15.160:6819/25443","state":["exists","up"]},{"osd":3,"uuid":"c53ed58d-a1f3-4783-8677-9348a1d103f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":25440},{"type":"v1","addr":"172.21.15.160:6801","nonce":25440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":25440},{"type":"v1","addr":"172.21.15.160:6803","nonce":25440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":25440},{"type":"v1","addr":"172.21.15.160:6807","nonce":25440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":25440},{"type":"v1","addr":"172.21.15.160:6805","nonce":25440}]},"public_addr":"172.21.15.160:6801/25440","cluster_addr":"172.21.15.160:6803/25440","heartbeat_back_addr":"172.21.15.160:6807/25440","heartbeat_front_addr":"172.21.15.160:6805/25440","state":["exists","up"]},{"osd":4,"uuid":"5713dbd4-1736-4ebf-8102-e80f4db6bcc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":25559},{"type":"v1","addr":"172.21.15.171:6817","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":25559},{"type":"v1","addr":"172.21.15.171:6819","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":25559},{"type":"v1","addr":"172.21.15.171:6826","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":25559},{"type":"v1","addr":"172.21.15.171:6821","nonce":25559}]},"public_addr":"172.21.15.171:6817/25559","cluster_addr":"172.21.15.171:6819/25559","heartbeat_back_addr":"172.21.15.171:6826/25559","heartbeat_front_addr":"172.21.15.171:6821/25559","state":["exists","up"]},{"osd":5,"uuid":"dfe21128-6ae6-4662-9f47-1bbb423a2232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":25549},{"type":"v1","addr":"172.21.15.171:6801","nonce":25549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":25549},{"type":"v1","addr":"172.21.15.171:6803","nonce":25549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":25549},{"type":"v1","addr":"172.21.15.171:6807","nonce":25549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":25549},{"type":"v1","addr":"172.21.15.171:6805","nonce":25549}]},"public_addr":"172.21.15.171:6801/25549","cluster_addr":"172.21.15.171:6803/25549","heartbeat_back_addr":"172.21.15.171:6807/25549","heartbeat_front_addr":"172.21.15.171:6805/25549","state":["exists","up"]},{"osd":6,"uuid":"24a9b956-5fa1-41bf-a689-0f048b7f19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":25574},{"type":"v1","addr":"172.21.15.171:6823","nonce":25574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":25574},{"type":"v1","addr":"172.21.15.171:6827","nonce":25574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":25574},{"type":"v1","addr":"172.21.15.171:6831","nonce":25574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":25574},{"type":"v1","addr":"172.21.15.171:6829","nonce":25574}]},"public_addr":"172.21.15.171:6823/25574","cluster_addr":"172.21.15.171:6827/25574","heartbeat_back_addr":"172.21.15.171:6831/25574","heartbeat_front_addr":"172.21.15.171:6829/25574","state":["exists","up"]},{"osd":7,"uuid":"a5ab4a14-8a7b-43b8-932c-a950f81c10f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":25550},{"type":"v1","addr":"172.21.15.171:6809","nonce":25550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":25550},{"type":"v1","addr":"172.21.15.171:6811","nonce":25550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":25550},{"type":"v1","addr":"172.21.15.171:6815","nonce":25550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":25550},{"type":"v1","addr":"172.21.15.171:6813","nonce":25550}]},"public_addr":"172.21.15.171:6809/25550","cluster_addr":"172.21.15.171:6811/25550","heartbeat_back_addr":"172.21.15.171:6815/25550","heartbeat_front_addr":"172.21.15.171:6813/25550","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.888796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.906098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.896027+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.876694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954695+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.846031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.954167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-21T13:54:17.883631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-21T13:54:52.176 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 -- 172.21.15.160:0/706677834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fbed8063ce0 msgr2=0x7fbed8066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.176 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fbed8063ce0 0x7fbed8066190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbee80018a0 tx=0x7fbee8009040 comp rx=0 tx=0).stop 2022-03-21T13:54:52.177 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 -- 172.21.15.160:0/706677834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbef814ce20 msgr2=0x7fbef80c0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.177 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbef814ce20 0x7fbef80c0150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbef000cb90 tx=0x7fbef0001da0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.177 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 -- 172.21.15.160:0/706677834 shutdown_connections 2022-03-21T13:54:52.177 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fbed8063ce0 0x7fbed8066190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.177 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbef814ce20 0x7fbef80c0150 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.178 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbef806c1c0 0x7fbef80bcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.178 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 --2- 172.21.15.160:0/706677834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef814ca50 0x7fbef80be580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.178 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 -- 172.21.15.160:0/706677834 >> 172.21.15.160:0/706677834 conn(0x7fbef80c9710 msgr2=0x7fbef81548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:52.178 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 -- 172.21.15.160:0/706677834 shutdown_connections 2022-03-21T13:54:52.178 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.174+0000 7fbefdce9700 1 -- 172.21.15.160:0/706677834 wait complete. 2022-03-21T13:54:52.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-03-21T13:54:21.458770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2022-03-21T13:54:21.499620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-03-21T13:54:25.482900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-03-21T13:54:26.501704+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-03-21T13:54:52.189 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-03-21T13:54:52.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.304+0000 7f644ea80700 1 Processor -- start 2022-03-21T13:54:52.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.304+0000 7f644ea80700 1 -- start start 2022-03-21T13:54:52.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.305+0000 7f644ea80700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 0x7f64480c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.305+0000 7f644ea80700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f644806c070 0x7f644806c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.305+0000 7f644ea80700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6448067cb0 con 0x7f64480c3c50 2022-03-21T13:54:52.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.305+0000 7f644ea80700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644806ca50 con 0x7f644806c070 2022-03-21T13:54:52.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.305+0000 7f644ea80700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6448066dc0 con 0x7f644806d480 2022-03-21T13:54:52.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.305+0000 7f644c81c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 0x7f64480c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.310 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f644d01d700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f644806c070 0x7f644806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f644c81c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 0x7f64480c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.160:47332/0 (socket says 172.21.15.160:47332) 2022-03-21T13:54:52.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f644c81c700 1 -- 172.21.15.160:0/763569756 learned_addr learned my addr 172.21.15.160:0/763569756 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:52.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f644c81c700 1 -- 172.21.15.160:0/763569756 >> v2:172.21.15.171:3300/0 conn(0x7f644806c070 msgr2=0x7f644806c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:52.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f644c81c700 1 --2- 172.21.15.160:0/763569756 >> v2:172.21.15.171:3300/0 conn(0x7f644806c070 0x7f644806c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.311 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f644c81c700 1 -- 172.21.15.160:0/763569756 >> v1:172.21.15.171:6789/0 conn(0x7f64480c3c50 legacy=0x7f64480c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f644c81c700 1 -- 172.21.15.160:0/763569756 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64480670a0 con 0x7f644806d480 2022-03-21T13:54:52.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f644d01d700 1 --2- 172.21.15.160:0/763569756 >> v2:172.21.15.171:3300/0 conn(0x7f644806c070 0x7f644806c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:54:52.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f644c81c700 1 --2- 172.21.15.160:0/763569756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 0x7f64480c3710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6430006fd0 tx=0x7f64300090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a4f2cdc7eda26a7 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:52.312 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f64477fe700 1 -- 172.21.15.160:0/763569756 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6430004030 con 0x7f644806d480 2022-03-21T13:54:52.313 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f64477fe700 1 -- 172.21.15.160:0/763569756 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64300041d0 con 0x7f644806d480 2022-03-21T13:54:52.313 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.306+0000 7f64477fe700 1 -- 172.21.15.160:0/763569756 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6430011630 con 0x7f644806d480 2022-03-21T13:54:52.313 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.307+0000 7f644ea80700 1 -- 172.21.15.160:0/763569756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 msgr2=0x7f64480c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.313 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.307+0000 7f644ea80700 1 --2- 172.21.15.160:0/763569756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 0x7f64480c3710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6430006fd0 tx=0x7f64300090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.313 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.307+0000 7f644ea80700 1 -- 172.21.15.160:0/763569756 shutdown_connections 2022-03-21T13:54:52.314 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.307+0000 7f644ea80700 1 --2- 172.21.15.160:0/763569756 >> v2:172.21.15.171:3300/0 conn(0x7f644806c070 0x7f644806c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.314 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.307+0000 7f644ea80700 1 --2- 172.21.15.160:0/763569756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 0x7f64480c3710 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.314 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.307+0000 7f644ea80700 1 -- 172.21.15.160:0/763569756 >> 172.21.15.160:0/763569756 conn(0x7f64480c9910 msgr2=0x7f64480c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:52.314 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.307+0000 7f644ea80700 1 -- 172.21.15.160:0/763569756 shutdown_connections 2022-03-21T13:54:52.315 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.307+0000 7f644ea80700 1 -- 172.21.15.160:0/763569756 wait complete. 2022-03-21T13:54:52.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.308+0000 7f644ea80700 1 Processor -- start 2022-03-21T13:54:52.318 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.308+0000 7f644ea80700 1 -- start start 2022-03-21T13:54:52.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644ea80700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f644806c070 0x7f64481692c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644ea80700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 0x7f64480c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644ea80700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64480c3c50 0x7f644814c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644ea80700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644814f0b0 con 0x7f64480c3c50 2022-03-21T13:54:52.319 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644ea80700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6448169800 con 0x7f644806c070 2022-03-21T13:54:52.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644ea80700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64480c2ae0 con 0x7f644806d480 2022-03-21T13:54:52.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644d01d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64480c3c50 0x7f644814c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644d01d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64480c3c50 0x7f644814c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56946/0 (socket says 172.21.15.160:56946) 2022-03-21T13:54:52.320 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644d01d700 1 -- 172.21.15.160:0/3747697378 learned_addr learned my addr 172.21.15.160:0/3747697378 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:52.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644c81c700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f644806c070 0x7f64481692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f6447fff700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 0x7f64480c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644d01d700 1 -- 172.21.15.160:0/3747697378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 msgr2=0x7f64480c25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644d01d700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 0x7f64480c25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.321 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644d01d700 1 -- 172.21.15.160:0/3747697378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f644806c070 msgr2=0x7f64481692c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644d01d700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f644806c070 0x7f64481692c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644d01d700 1 -- 172.21.15.160:0/3747697378 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400092a0 con 0x7f64480c3c50 2022-03-21T13:54:52.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f644d01d700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64480c3c50 0x7f644814c030 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f644000e9e0 tx=0x7f6440009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:52.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.309+0000 7f6444ff9700 1 -- 172.21.15.160:0/3747697378 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440004020 con 0x7f64480c3c50 2022-03-21T13:54:52.322 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.310+0000 7f6444ff9700 1 -- 172.21.15.160:0/3747697378 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440004180 con 0x7f64480c3c50 2022-03-21T13:54:52.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.310+0000 7f644ea80700 1 -- 172.21.15.160:0/3747697378 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6430009370 con 0x7f64480c3c50 2022-03-21T13:54:52.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.310+0000 7f6444ff9700 1 -- 172.21.15.160:0/3747697378 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644000c850 con 0x7f64480c3c50 2022-03-21T13:54:52.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.310+0000 7f644ea80700 1 -- 172.21.15.160:0/3747697378 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6448153ba0 con 0x7f64480c3c50 2022-03-21T13:54:52.323 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.311+0000 7f644ea80700 1 -- 172.21.15.160:0/3747697378 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644814ece0 con 0x7f64480c3c50 2022-03-21T13:54:52.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.311+0000 7f6444ff9700 1 -- 172.21.15.160:0/3747697378 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f644000cc00 con 0x7f64480c3c50 2022-03-21T13:54:52.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.311+0000 7f6444ff9700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f642c063d10 0x7f642c0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.311+0000 7f6444ff9700 1 -- 172.21.15.160:0/3747697378 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6440080880 con 0x7f64480c3c50 2022-03-21T13:54:52.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.311+0000 7f644c81c700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f642c063d10 0x7f642c0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.324 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.312+0000 7f644c81c700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f642c063d10 0x7f642c0661c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6430009340 tx=0x7f6430016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:52.325 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.316+0000 7f6444ff9700 1 -- 172.21.15.160:0/3747697378 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f644004f460 con 0x7f64480c3c50 2022-03-21T13:54:52.486 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.484+0000 7f644ea80700 1 -- 172.21.15.160:0/3747697378 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6448067380 con 0x7f64480c3c50 2022-03-21T13:54:52.486 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.484+0000 7f6444ff9700 1 -- 172.21.15.160:0/3747697378 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f64400200a0 con 0x7f64480c3c50 2022-03-21T13:54:52.487 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2022-03-21T13:54:52.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 -- 172.21.15.160:0/3747697378 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f642c063d10 msgr2=0x7f642c0661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f642c063d10 0x7f642c0661c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6430009340 tx=0x7f6430016000 comp rx=0 tx=0).stop 2022-03-21T13:54:52.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 -- 172.21.15.160:0/3747697378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64480c3c50 msgr2=0x7f644814c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64480c3c50 0x7f644814c030 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f644000e9e0 tx=0x7f6440009060 comp rx=0 tx=0).stop 2022-03-21T13:54:52.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 -- 172.21.15.160:0/3747697378 shutdown_connections 2022-03-21T13:54:52.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f642c063d10 0x7f642c0661c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64480c3c50 0x7f644814c030 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f644806c070 0x7f64481692c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 --2- 172.21.15.160:0/3747697378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f644806d480 0x7f64480c25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 -- 172.21.15.160:0/3747697378 >> 172.21.15.160:0/3747697378 conn(0x7f64480c9910 msgr2=0x7f644814e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:52.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 -- 172.21.15.160:0/3747697378 shutdown_connections 2022-03-21T13:54:52.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.486+0000 7f644ea80700 1 -- 172.21.15.160:0/3747697378 wait complete. 2022-03-21T13:54:52.499 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-03-21T13:54:52.615 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.613+0000 7f476adb1700 1 Processor -- start 2022-03-21T13:54:52.615 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.613+0000 7f476adb1700 1 -- start start 2022-03-21T13:54:52.622 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.614+0000 7f476adb1700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f476406c780 0x7f47640c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.622 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.614+0000 7f476adb1700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4764067cb0 con 0x7f476406d480 2022-03-21T13:54:52.623 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.614+0000 7f476adb1700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4764066dc0 con 0x7f47640c4380 2022-03-21T13:54:52.623 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.614+0000 7f476adb1700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47640670a0 con 0x7f476406c780 2022-03-21T13:54:52.623 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.614+0000 7f4768b4d700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f476406d480 0x7f47640c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:60102/0 (socket says 172.21.15.160:60102) 2022-03-21T13:54:52.623 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.614+0000 7f4768b4d700 1 -- 172.21.15.160:0/712741786 learned_addr learned my addr 172.21.15.160:0/712741786 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:52.624 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.614+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709729822 0 0) 0x7f4764067cb0 con 0x7f476406d480 2022-03-21T13:54:52.624 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47500033f0 con 0x7f476406d480 2022-03-21T13:54:52.624 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.614+0000 7f476934e700 1 --2- 172.21.15.160:0/712741786 >> v2:172.21.15.171:3300/0 conn(0x7f476406c780 0x7f47640c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.624 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 862975820 0 0) 0x7f47500033f0 con 0x7f476406d480 2022-03-21T13:54:52.624 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 >> v2:172.21.15.171:3300/0 conn(0x7f476406c780 msgr2=0x7f47640c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:52.625 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 --2- 172.21.15.160:0/712741786 >> v2:172.21.15.171:3300/0 conn(0x7f476406c780 0x7f47640c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.625 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 >> v1:172.21.15.171:6789/0 conn(0x7f47640c4380 legacy=0x7f476406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.625 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764067380 con 0x7f476406d480 2022-03-21T13:54:52.625 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7f4754001470 con 0x7f476406d480 2022-03-21T13:54:52.626 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 >> v1:172.21.15.160:6789/0 conn(0x7f476406d480 legacy=0x7f47640c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.626 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 --2- 172.21.15.160:0/712741786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47500038e0 0x7f4750003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.626 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 --2- 172.21.15.160:0/712741786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4750004690 0x7f4750004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.626 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 --2- 172.21.15.160:0/712741786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 0x7f475000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.627 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47640670a0 con 0x7f4750005040 2022-03-21T13:54:52.627 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475000bf50 con 0x7f4750004690 2022-03-21T13:54:52.627 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475000c110 con 0x7f47500038e0 2022-03-21T13:54:52.627 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f476934e700 1 --2- 172.21.15.160:0/712741786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 0x7f475000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.628 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f4763fff700 1 --2- 172.21.15.160:0/712741786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4750004690 0x7f4750004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.628 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f4768b4d700 1 --2- 172.21.15.160:0/712741786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47500038e0 0x7f4750003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.628 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f476934e700 1 -- 172.21.15.160:0/712741786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47500038e0 msgr2=0x7f4750003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:52.628 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f476934e700 1 --2- 172.21.15.160:0/712741786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47500038e0 0x7f4750003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.628 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f476934e700 1 -- 172.21.15.160:0/712741786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4750004690 msgr2=0x7f4750004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:52.629 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f476934e700 1 --2- 172.21.15.160:0/712741786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4750004690 0x7f4750004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.629 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f476934e700 1 -- 172.21.15.160:0/712741786 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47500033f0 con 0x7f4750005040 2022-03-21T13:54:52.629 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f476934e700 1 -- 172.21.15.160:0/712741786 reap_dead start 2022-03-21T13:54:52.629 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f476934e700 1 --2- 172.21.15.160:0/712741786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 0x7f475000b8e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f476406cba0 tx=0x7f475c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d0a1c2731707bd server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:52.630 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00ea90 con 0x7f4750005040 2022-03-21T13:54:52.630 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c00f040 con 0x7f4750005040 2022-03-21T13:54:52.630 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.615+0000 7f47637fe700 1 -- 172.21.15.160:0/712741786 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00ee40 con 0x7f4750005040 2022-03-21T13:54:52.630 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.616+0000 7f476adb1700 1 -- 172.21.15.160:0/712741786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 msgr2=0x7f475000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.631 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.616+0000 7f476adb1700 1 --2- 172.21.15.160:0/712741786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 0x7f475000b8e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f476406cba0 tx=0x7f475c00b040 comp rx=0 tx=0).stop 2022-03-21T13:54:52.631 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.616+0000 7f476adb1700 1 -- 172.21.15.160:0/712741786 shutdown_connections 2022-03-21T13:54:52.631 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.616+0000 7f476adb1700 1 --2- 172.21.15.160:0/712741786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 0x7f475000b8e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.631 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.616+0000 7f476adb1700 1 -- 172.21.15.160:0/712741786 >> 172.21.15.160:0/712741786 conn(0x7f47640c9910 msgr2=0x7f47640c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:52.631 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.616+0000 7f476adb1700 1 -- 172.21.15.160:0/712741786 shutdown_connections 2022-03-21T13:54:52.632 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.616+0000 7f476adb1700 1 -- 172.21.15.160:0/712741786 wait complete. 2022-03-21T13:54:52.632 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.617+0000 7f476adb1700 1 Processor -- start 2022-03-21T13:54:52.632 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.617+0000 7f476adb1700 1 -- start start 2022-03-21T13:54:52.632 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f476adb1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 0x7f4764169190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.633 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f476adb1700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4764156c70 0x7f47640beeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.633 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f476adb1700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47641572f0 0x7f4764157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.633 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f476adb1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47641696d0 con 0x7f4750005040 2022-03-21T13:54:52.633 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f476adb1700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764157c80 con 0x7f4764156c70 2022-03-21T13:54:52.633 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f476adb1700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47640c7e10 con 0x7f47641572f0 2022-03-21T13:54:52.634 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f4768b4d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 0x7f4764169190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.634 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f4768b4d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 0x7f4764169190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56962/0 (socket says 172.21.15.160:56962) 2022-03-21T13:54:52.634 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f4768b4d700 1 -- 172.21.15.160:0/4268688841 learned_addr learned my addr 172.21.15.160:0/4268688841 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:52.634 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f476934e700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47641572f0 0x7f4764157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.634 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f4763fff700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4764156c70 0x7f47640beeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.635 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f4768b4d700 1 -- 172.21.15.160:0/4268688841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47641572f0 msgr2=0x7f4764157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.635 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f4768b4d700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47641572f0 0x7f4764157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.635 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f4768b4d700 1 -- 172.21.15.160:0/4268688841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4764156c70 msgr2=0x7f47640beeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.635 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f4768b4d700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4764156c70 0x7f47640beeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.635 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f4768b4d700 1 -- 172.21.15.160:0/4268688841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47641593c0 con 0x7f4750005040 2022-03-21T13:54:52.636 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f476934e700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47641572f0 0x7f4764157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:54:52.636 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.618+0000 7f4768b4d700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 0x7f4764169190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f47540049e0 tx=0x7f4754001e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:52.636 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.619+0000 7f4760ff9700 1 -- 172.21.15.160:0/4268688841 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754004e50 con 0x7f4750005040 2022-03-21T13:54:52.636 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.619+0000 7f4760ff9700 1 -- 172.21.15.160:0/4268688841 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475400f870 con 0x7f4750005040 2022-03-21T13:54:52.636 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.619+0000 7f476adb1700 1 -- 172.21.15.160:0/4268688841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4764159100 con 0x7f4750005040 2022-03-21T13:54:52.637 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.619+0000 7f4760ff9700 1 -- 172.21.15.160:0/4268688841 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400fc30 con 0x7f4750005040 2022-03-21T13:54:52.637 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.619+0000 7f476adb1700 1 -- 172.21.15.160:0/4268688841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4764159940 con 0x7f4750005040 2022-03-21T13:54:52.637 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.619+0000 7f476adb1700 1 -- 172.21.15.160:0/4268688841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476406fc00 con 0x7f4750005040 2022-03-21T13:54:52.637 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.620+0000 7f4760ff9700 1 -- 172.21.15.160:0/4268688841 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f475401d460 con 0x7f4750005040 2022-03-21T13:54:52.637 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.620+0000 7f4760ff9700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4744063d10 0x7f47440661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.638 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.620+0000 7f4760ff9700 1 -- 172.21.15.160:0/4268688841 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4754080a80 con 0x7f4750005040 2022-03-21T13:54:52.638 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.620+0000 7f4763fff700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4744063d10 0x7f47440661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.638 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.621+0000 7f4763fff700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4744063d10 0x7f47440661c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4758007fd0 tx=0x7f4758009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:52.639 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.624+0000 7f4760ff9700 1 -- 172.21.15.160:0/4268688841 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f475404f600 con 0x7f4750005040 2022-03-21T13:54:52.795 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.793+0000 7f476adb1700 1 -- 172.21.15.160:0/4268688841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4764067660 con 0x7f4750005040 2022-03-21T13:54:52.795 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.794+0000 7f4760ff9700 1 -- 172.21.15.160:0/4268688841 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4764067660 con 0x7f4750005040 2022-03-21T13:54:52.796 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 1 2022-03-21T13:54:52.798 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.795+0000 7f476adb1700 1 -- 172.21.15.160:0/4268688841 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4744063d10 msgr2=0x7f47440661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.798 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.796+0000 7f476adb1700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4744063d10 0x7f47440661c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4758007fd0 tx=0x7f4758009040 comp rx=0 tx=0).stop 2022-03-21T13:54:52.798 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.796+0000 7f476adb1700 1 -- 172.21.15.160:0/4268688841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 msgr2=0x7f4764169190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.798 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.796+0000 7f476adb1700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 0x7f4764169190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f47540049e0 tx=0x7f4754001e30 comp rx=0 tx=0).stop 2022-03-21T13:54:52.799 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.796+0000 7f476adb1700 1 -- 172.21.15.160:0/4268688841 shutdown_connections 2022-03-21T13:54:52.799 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.796+0000 7f476adb1700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4744063d10 0x7f47440661c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.799 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.796+0000 7f476adb1700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47641572f0 0x7f4764157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.799 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.796+0000 7f476adb1700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4750005040 0x7f4764169190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.800 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.796+0000 7f476adb1700 1 --2- 172.21.15.160:0/4268688841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4764156c70 0x7f47640beeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.800 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.796+0000 7f476adb1700 1 -- 172.21.15.160:0/4268688841 >> 172.21.15.160:0/4268688841 conn(0x7f47640c9910 msgr2=0x7f47640c7620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:52.800 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.796+0000 7f476adb1700 1 -- 172.21.15.160:0/4268688841 shutdown_connections 2022-03-21T13:54:52.800 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.796+0000 7f476adb1700 1 -- 172.21.15.160:0/4268688841 wait complete. 2022-03-21T13:54:52.809 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-03-21T13:54:52.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.924+0000 7f08fc231700 1 Processor -- start 2022-03-21T13:54:52.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.924+0000 7f08fc231700 1 -- start start 2022-03-21T13:54:52.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.924+0000 7f08fc231700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08f4158350 0x7f08f4158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.924+0000 7f08fc231700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f08f40c7400 0x7f08f4158c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.924+0000 7f08fc231700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f40c4ec0 con 0x7f08f406a720 2022-03-21T13:54:52.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.924+0000 7f08fc231700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f40c5a10 con 0x7f08f40c7400 2022-03-21T13:54:52.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.924+0000 7f08fc231700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f40c53d0 con 0x7f08f4158350 2022-03-21T13:54:52.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.924+0000 7f08f97cc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f08f40c7400 0x7f08f4158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f97cc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f08f40c7400 0x7f08f4158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56972/0 (socket says 172.21.15.160:56972) 2022-03-21T13:54:52.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f97cc700 1 -- 172.21.15.160:0/2812397670 learned_addr learned my addr 172.21.15.160:0/2812397670 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:52.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f9fcd700 1 --2- 172.21.15.160:0/2812397670 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08f4158350 0x7f08f4158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f97cc700 1 -- 172.21.15.160:0/2812397670 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08f4158350 msgr2=0x7f08f4158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:52.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f97cc700 1 --2- 172.21.15.160:0/2812397670 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08f4158350 0x7f08f4158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f97cc700 1 -- 172.21.15.160:0/2812397670 >> v1:172.21.15.171:6789/0 conn(0x7f08f406a720 legacy=0x7f08f40c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:52.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f97cc700 1 -- 172.21.15.160:0/2812397670 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f406a290 con 0x7f08f40c7400 2022-03-21T13:54:52.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f9fcd700 1 --2- 172.21.15.160:0/2812397670 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08f4158350 0x7f08f4158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:54:52.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f97cc700 1 --2- 172.21.15.160:0/2812397670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40c7400 0x7f08f4158c60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f08e8006fd0 tx=0x7f08e80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a15ed7702dc4edf server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:52.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f8fcb700 1 -- 172.21.15.160:0/2812397670 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8011630 con 0x7f08f40c7400 2022-03-21T13:54:52.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f8fcb700 1 -- 172.21.15.160:0/2812397670 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e80117b0 con 0x7f08f40c7400 2022-03-21T13:54:52.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08f8fcb700 1 -- 172.21.15.160:0/2812397670 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8011b70 con 0x7f08f40c7400 2022-03-21T13:54:52.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08fc231700 1 -- 172.21.15.160:0/2812397670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40c7400 msgr2=0x7f08f4158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.925+0000 7f08fc231700 1 --2- 172.21.15.160:0/2812397670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40c7400 0x7f08f4158c60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f08e8006fd0 tx=0x7f08e80090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.926+0000 7f08fc231700 1 -- 172.21.15.160:0/2812397670 shutdown_connections 2022-03-21T13:54:52.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.926+0000 7f08fc231700 1 --2- 172.21.15.160:0/2812397670 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08f4158350 0x7f08f4158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.926+0000 7f08fc231700 1 --2- 172.21.15.160:0/2812397670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40c7400 0x7f08f4158c60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.926+0000 7f08fc231700 1 -- 172.21.15.160:0/2812397670 >> 172.21.15.160:0/2812397670 conn(0x7f08f40cb000 msgr2=0x7f08f40cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:52.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.926+0000 7f08fc231700 1 -- 172.21.15.160:0/2812397670 shutdown_connections 2022-03-21T13:54:52.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.926+0000 7f08fc231700 1 -- 172.21.15.160:0/2812397670 wait complete. 2022-03-21T13:54:52.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.927+0000 7f08fc231700 1 Processor -- start 2022-03-21T13:54:52.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.927+0000 7f08fc231700 1 -- start start 2022-03-21T13:54:52.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08fc231700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08f406a720 0x7f08f41532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08fc231700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40c7400 0x7f08f41503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08fc231700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08f4158350 0x7f08f414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08fc231700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f40c17a0 con 0x7f08f40c7400 2022-03-21T13:54:52.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08fc231700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f4158d80 con 0x7f08f406a720 2022-03-21T13:54:52.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08fc231700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f4153db0 con 0x7f08f4158350 2022-03-21T13:54:52.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f97cc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40c7400 0x7f08f41503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f97cc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40c7400 0x7f08f41503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56976/0 (socket says 172.21.15.160:56976) 2022-03-21T13:54:52.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f97cc700 1 -- 172.21.15.160:0/182078862 learned_addr learned my addr 172.21.15.160:0/182078862 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:52.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f9fcd700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08f406a720 0x7f08f41532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08fa7ce700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08f4158350 0x7f08f414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f97cc700 1 -- 172.21.15.160:0/182078862 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08f4158350 msgr2=0x7f08f414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f97cc700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08f4158350 0x7f08f414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f97cc700 1 -- 172.21.15.160:0/182078862 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08f406a720 msgr2=0x7f08f41532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:52.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f97cc700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08f406a720 0x7f08f41532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:52.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f97cc700 1 -- 172.21.15.160:0/182078862 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e8009370 con 0x7f08f40c7400 2022-03-21T13:54:52.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f97cc700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40c7400 0x7f08f41503d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009130 tx=0x7f08e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:52.940 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f1ffb700 1 -- 172.21.15.160:0/182078862 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e80036f0 con 0x7f08f40c7400 2022-03-21T13:54:52.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f1ffb700 1 -- 172.21.15.160:0/182078862 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e8003870 con 0x7f08f40c7400 2022-03-21T13:54:52.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08fc231700 1 -- 172.21.15.160:0/182078862 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f4153fe0 con 0x7f08f40c7400 2022-03-21T13:54:52.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08f1ffb700 1 -- 172.21.15.160:0/182078862 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8003c30 con 0x7f08f40c7400 2022-03-21T13:54:52.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.928+0000 7f08fc231700 1 -- 172.21.15.160:0/182078862 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f40c2000 con 0x7f08f40c7400 2022-03-21T13:54:52.941 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.929+0000 7f08fc231700 1 -- 172.21.15.160:0/182078862 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f4070ae0 con 0x7f08f40c7400 2022-03-21T13:54:52.942 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.930+0000 7f08f1ffb700 1 -- 172.21.15.160:0/182078862 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f08e802b030 con 0x7f08f40c7400 2022-03-21T13:54:52.942 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.930+0000 7f08f1ffb700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f08d4063ce0 0x7f08d4066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:52.942 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.930+0000 7f08f9fcd700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f08d4063ce0 0x7f08d4066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:52.942 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.930+0000 7f08f1ffb700 1 -- 172.21.15.160:0/182078862 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f08e8081d60 con 0x7f08f40c7400 2022-03-21T13:54:52.942 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.931+0000 7f08f9fcd700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f08d4063ce0 0x7f08d4066190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f08e400d6e0 tx=0x7f08e4007850 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:52.943 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:52.935+0000 7f08f1ffb700 1 -- 172.21.15.160:0/182078862 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f08e8050940 con 0x7f08f40c7400 2022-03-21T13:54:53.107 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.105+0000 7f08fc231700 1 -- 172.21.15.160:0/182078862 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08f40702c0 con 0x7f08f40c7400 2022-03-21T13:54:53.107 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.106+0000 7f08f1ffb700 1 -- 172.21.15.160:0/182078862 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08e8053f60 con 0x7f08f40c7400 2022-03-21T13:54:53.108 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 32 2022-03-21T13:54:53.110 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.107+0000 7f08fc231700 1 -- 172.21.15.160:0/182078862 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f08d4063ce0 msgr2=0x7f08d4066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.110 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.107+0000 7f08fc231700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f08d4063ce0 0x7f08d4066190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f08e400d6e0 tx=0x7f08e4007850 comp rx=0 tx=0).stop 2022-03-21T13:54:53.110 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.107+0000 7f08fc231700 1 -- 172.21.15.160:0/182078862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40c7400 msgr2=0x7f08f41503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.110 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.107+0000 7f08fc231700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40c7400 0x7f08f41503d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009130 tx=0x7f08e8017000 comp rx=0 tx=0).stop 2022-03-21T13:54:53.111 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.107+0000 7f08fc231700 1 -- 172.21.15.160:0/182078862 shutdown_connections 2022-03-21T13:54:53.111 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.107+0000 7f08fc231700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f08d4063ce0 0x7f08d4066190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.111 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.107+0000 7f08fc231700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08f4158350 0x7f08f414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.111 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.107+0000 7f08fc231700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08f406a720 0x7f08f41532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.111 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.107+0000 7f08fc231700 1 --2- 172.21.15.160:0/182078862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40c7400 0x7f08f41503d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.112 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.108+0000 7f08fc231700 1 -- 172.21.15.160:0/182078862 >> 172.21.15.160:0/182078862 conn(0x7f08f40cb000 msgr2=0x7f08f40c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:53.112 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.108+0000 7f08fc231700 1 -- 172.21.15.160:0/182078862 shutdown_connections 2022-03-21T13:54:53.112 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.108+0000 7f08fc231700 1 -- 172.21.15.160:0/182078862 wait complete. 2022-03-21T13:54:53.121 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-03-21T13:54:53.237 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec7a6ac700 1 Processor -- start 2022-03-21T13:54:53.238 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec7a6ac700 1 -- start start 2022-03-21T13:54:53.240 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec7a6ac700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fec7406d760 0x7fec7406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.240 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec7a6ac700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fec7406c5b0 0x7fec74155220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.241 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec7a6ac700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7406b5a0 con 0x7fec740c6210 2022-03-21T13:54:53.241 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec7a6ac700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7406db30 con 0x7fec7406c5b0 2022-03-21T13:54:53.241 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec7a6ac700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7406ca30 con 0x7fec7406d760 2022-03-21T13:54:53.241 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec78c49700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fec7406c5b0 0x7fec74155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.242 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec78c49700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fec7406c5b0 0x7fec74155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56990/0 (socket says 172.21.15.160:56990) 2022-03-21T13:54:53.242 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec78c49700 1 -- 172.21.15.160:0/1717231012 learned_addr learned my addr 172.21.15.160:0/1717231012 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:53.242 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec73fff700 1 --2- 172.21.15.160:0/1717231012 >> v2:172.21.15.171:3300/0 conn(0x7fec7406d760 0x7fec7406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.242 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec78c49700 1 -- 172.21.15.160:0/1717231012 >> v2:172.21.15.171:3300/0 conn(0x7fec7406d760 msgr2=0x7fec7406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:53.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec78c49700 1 --2- 172.21.15.160:0/1717231012 >> v2:172.21.15.171:3300/0 conn(0x7fec7406d760 0x7fec7406c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec78c49700 1 -- 172.21.15.160:0/1717231012 >> v1:172.21.15.171:6789/0 conn(0x7fec740c6210 legacy=0x7fec74154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:53.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec78c49700 1 -- 172.21.15.160:0/1717231012 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7406a9e0 con 0x7fec7406c5b0 2022-03-21T13:54:53.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec78c49700 1 --2- 172.21.15.160:0/1717231012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec7406c5b0 0x7fec74155220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fec74068ad0 tx=0x7fec6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972ebc521de2cc52 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:53.243 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec72ffd700 1 -- 172.21.15.160:0/1717231012 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c00e070 con 0x7fec7406c5b0 2022-03-21T13:54:53.244 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec72ffd700 1 -- 172.21.15.160:0/1717231012 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c00baa0 con 0x7fec7406c5b0 2022-03-21T13:54:53.244 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.237+0000 7fec72ffd700 1 -- 172.21.15.160:0/1717231012 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c0092e0 con 0x7fec7406c5b0 2022-03-21T13:54:53.244 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.238+0000 7fec7a6ac700 1 -- 172.21.15.160:0/1717231012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec7406c5b0 msgr2=0x7fec74155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.244 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.238+0000 7fec7a6ac700 1 --2- 172.21.15.160:0/1717231012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec7406c5b0 0x7fec74155220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fec74068ad0 tx=0x7fec6c009840 comp rx=0 tx=0).stop 2022-03-21T13:54:53.245 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.238+0000 7fec7a6ac700 1 -- 172.21.15.160:0/1717231012 shutdown_connections 2022-03-21T13:54:53.245 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.238+0000 7fec7a6ac700 1 --2- 172.21.15.160:0/1717231012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec7406c5b0 0x7fec74155220 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.245 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.238+0000 7fec7a6ac700 1 --2- 172.21.15.160:0/1717231012 >> v2:172.21.15.171:3300/0 conn(0x7fec7406d760 0x7fec7406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.245 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.238+0000 7fec7a6ac700 1 -- 172.21.15.160:0/1717231012 >> 172.21.15.160:0/1717231012 conn(0x7fec74068640 msgr2=0x7fec740cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:53.245 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.238+0000 7fec7a6ac700 1 -- 172.21.15.160:0/1717231012 shutdown_connections 2022-03-21T13:54:53.245 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.238+0000 7fec7a6ac700 1 -- 172.21.15.160:0/1717231012 wait complete. 2022-03-21T13:54:53.246 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.239+0000 7fec7a6ac700 1 Processor -- start 2022-03-21T13:54:53.249 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.239+0000 7fec7a6ac700 1 -- start start 2022-03-21T13:54:53.249 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec7a6ac700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec7406c5b0 0x7fec740b9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.249 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec7a6ac700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec7406d760 0x7fec740b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.249 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec7a6ac700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec740c6210 0x7fec7414d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.250 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec7a6ac700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec740b8830 con 0x7fec7406d760 2022-03-21T13:54:53.250 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec7a6ac700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec74165eb0 con 0x7fec7406c5b0 2022-03-21T13:54:53.250 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec7a6ac700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec740b8a80 con 0x7fec740c6210 2022-03-21T13:54:53.250 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec737fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec7406d760 0x7fec740b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.250 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec737fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec7406d760 0x7fec740b9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56994/0 (socket says 172.21.15.160:56994) 2022-03-21T13:54:53.251 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec737fe700 1 -- 172.21.15.160:0/3423845554 learned_addr learned my addr 172.21.15.160:0/3423845554 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:53.251 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec73fff700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec7406c5b0 0x7fec740b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.251 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec78c49700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec740c6210 0x7fec7414d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.251 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec737fe700 1 -- 172.21.15.160:0/3423845554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec740c6210 msgr2=0x7fec7414d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.251 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec737fe700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec740c6210 0x7fec7414d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.252 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec737fe700 1 -- 172.21.15.160:0/3423845554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec7406c5b0 msgr2=0x7fec740b9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.252 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec737fe700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec7406c5b0 0x7fec740b9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.252 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec737fe700 1 -- 172.21.15.160:0/3423845554 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c009ae0 con 0x7fec7406d760 2022-03-21T13:54:53.252 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.240+0000 7fec737fe700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec7406d760 0x7fec740b9d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fec6800b460 tx=0x7fec68006f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:53.252 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.241+0000 7fec5bfff700 1 -- 172.21.15.160:0/3423845554 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68011420 con 0x7fec7406d760 2022-03-21T13:54:53.253 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.241+0000 7fec5bfff700 1 -- 172.21.15.160:0/3423845554 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec68011580 con 0x7fec7406d760 2022-03-21T13:54:53.253 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.241+0000 7fec7a6ac700 1 -- 172.21.15.160:0/3423845554 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec740b8d60 con 0x7fec7406d760 2022-03-21T13:54:53.253 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.241+0000 7fec5bfff700 1 -- 172.21.15.160:0/3423845554 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68011940 con 0x7fec7406d760 2022-03-21T13:54:53.253 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.241+0000 7fec7a6ac700 1 -- 172.21.15.160:0/3423845554 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec740b9320 con 0x7fec7406d760 2022-03-21T13:54:53.254 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.241+0000 7fec7a6ac700 1 -- 172.21.15.160:0/3423845554 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec740b9540 con 0x7fec7406d760 2022-03-21T13:54:53.254 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.242+0000 7fec5bfff700 1 -- 172.21.15.160:0/3423845554 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fec68021070 con 0x7fec7406d760 2022-03-21T13:54:53.254 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.242+0000 7fec5bfff700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec54063ce0 0x7fec54066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.254 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.242+0000 7fec5bfff700 1 -- 172.21.15.160:0/3423845554 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fec68080560 con 0x7fec7406d760 2022-03-21T13:54:53.254 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.242+0000 7fec73fff700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec54063ce0 0x7fec54066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.255 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.243+0000 7fec73fff700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec54063ce0 0x7fec54066190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec64003740 tx=0x7fec64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:53.255 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.247+0000 7fec5bfff700 1 -- 172.21.15.160:0/3423845554 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fec6804f140 con 0x7fec7406d760 2022-03-21T13:54:53.419 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.417+0000 7fec7a6ac700 1 -- 172.21.15.160:0/3423845554 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec7406fc00 con 0x7fec7406d760 2022-03-21T13:54:53.419 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.418+0000 7fec5bfff700 1 -- 172.21.15.160:0/3423845554 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec68015020 con 0x7fec7406d760 2022-03-21T13:54:53.420 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 64 2022-03-21T13:54:53.421 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.419+0000 7fec7a6ac700 1 -- 172.21.15.160:0/3423845554 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec54063ce0 msgr2=0x7fec54066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.422 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.419+0000 7fec7a6ac700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec54063ce0 0x7fec54066190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec64003740 tx=0x7fec64008040 comp rx=0 tx=0).stop 2022-03-21T13:54:53.422 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.419+0000 7fec7a6ac700 1 -- 172.21.15.160:0/3423845554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec7406d760 msgr2=0x7fec740b9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.422 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.419+0000 7fec7a6ac700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec7406d760 0x7fec740b9d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fec6800b460 tx=0x7fec68006f20 comp rx=0 tx=0).stop 2022-03-21T13:54:53.422 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.419+0000 7fec7a6ac700 1 -- 172.21.15.160:0/3423845554 shutdown_connections 2022-03-21T13:54:53.423 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.419+0000 7fec7a6ac700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fec54063ce0 0x7fec54066190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.423 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.420+0000 7fec7a6ac700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec740c6210 0x7fec7414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.423 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.420+0000 7fec7a6ac700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec7406c5b0 0x7fec740b9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.423 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.420+0000 7fec7a6ac700 1 --2- 172.21.15.160:0/3423845554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec7406d760 0x7fec740b9d80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.423 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.420+0000 7fec7a6ac700 1 -- 172.21.15.160:0/3423845554 >> 172.21.15.160:0/3423845554 conn(0x7fec74068640 msgr2=0x7fec740c3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:53.424 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.420+0000 7fec7a6ac700 1 -- 172.21.15.160:0/3423845554 shutdown_connections 2022-03-21T13:54:53.424 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.420+0000 7fec7a6ac700 1 -- 172.21.15.160:0/3423845554 wait complete. 2022-03-21T13:54:53.433 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-03-21T13:54:53.546 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.544+0000 7f9b2fb2a700 1 Processor -- start 2022-03-21T13:54:53.546 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.544+0000 7f9b2fb2a700 1 -- start start 2022-03-21T13:54:53.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.545+0000 7f9b2fb2a700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9b2806ac50 0x7f9b280c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.545+0000 7f9b2fb2a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2806b6d0 con 0x7f9b280c45d0 2022-03-21T13:54:53.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.545+0000 7f9b2fb2a700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b280c7300 con 0x7f9b280c49a0 2022-03-21T13:54:53.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.545+0000 7f9b2fb2a700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2806a6d0 con 0x7f9b2806ac50 2022-03-21T13:54:53.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.545+0000 7f9b2d8c6700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f9b280c45d0 0x7f9b280c58b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:60152/0 (socket says 172.21.15.160:60152) 2022-03-21T13:54:53.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.545+0000 7f9b2d8c6700 1 -- 172.21.15.160:0/449051091 learned_addr learned my addr 172.21.15.160:0/449051091 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:54:53.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.545+0000 7f9b2d0c5700 1 --2- 172.21.15.160:0/449051091 >> v2:172.21.15.171:3300/0 conn(0x7f9b2806ac50 0x7f9b280c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.545+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581427875 0 0) 0x7f9b2806b6d0 con 0x7f9b280c45d0 2022-03-21T13:54:53.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.545+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b140033f0 con 0x7f9b280c45d0 2022-03-21T13:54:53.554 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3503208828 0 0) 0x7f9b140033f0 con 0x7f9b280c45d0 2022-03-21T13:54:53.554 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 >> v2:172.21.15.171:3300/0 conn(0x7f9b2806ac50 msgr2=0x7f9b280c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:53.554 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 --2- 172.21.15.160:0/449051091 >> v2:172.21.15.171:3300/0 conn(0x7f9b2806ac50 0x7f9b280c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.554 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 >> v1:172.21.15.171:6789/0 conn(0x7f9b280c49a0 legacy=0x7f9b2815f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2806b900 con 0x7f9b280c45d0 2022-03-21T13:54:53.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7f9b180017f0 con 0x7f9b280c45d0 2022-03-21T13:54:53.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 >> v1:172.21.15.160:6789/0 conn(0x7f9b280c45d0 legacy=0x7f9b280c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b140038e0 0x7f9b14003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b14004690 0x7f9b14004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.556 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b14005040 0x7f9b1400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.556 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2806a6d0 con 0x7f9b140038e0 2022-03-21T13:54:53.556 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1400bf50 con 0x7f9b14005040 2022-03-21T13:54:53.556 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1400c110 con 0x7f9b14004690 2022-03-21T13:54:53.556 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2d8c6700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b140038e0 0x7f9b14003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.557 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2e0c7700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b14005040 0x7f9b1400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.557 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2d0c5700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b14004690 0x7f9b14004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.557 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2d8c6700 1 -- 172.21.15.160:0/449051091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b14004690 msgr2=0x7f9b14004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:53.557 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2d8c6700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b14004690 0x7f9b14004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.557 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2d8c6700 1 -- 172.21.15.160:0/449051091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b14005040 msgr2=0x7f9b1400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:53.558 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2d8c6700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b14005040 0x7f9b1400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.558 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2d8c6700 1 -- 172.21.15.160:0/449051091 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b140033f0 con 0x7f9b140038e0 2022-03-21T13:54:53.558 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2e0c7700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b14005040 0x7f9b1400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:53.558 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2e0c7700 1 -- 172.21.15.160:0/449051091 reap_dead start 2022-03-21T13:54:53.559 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2d8c6700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b140038e0 0x7f9b14003cf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800c5f0 tx=0x7f9b2806a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba573e788234504 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:53.559 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800cdf0 con 0x7f9b140038e0 2022-03-21T13:54:53.559 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b18005b20 con 0x7f9b140038e0 2022-03-21T13:54:53.559 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.546+0000 7f9b2c8c4700 1 -- 172.21.15.160:0/449051091 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b180070d0 con 0x7f9b140038e0 2022-03-21T13:54:53.559 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.547+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/449051091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b140038e0 msgr2=0x7f9b14003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.560 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.547+0000 7f9b2fb2a700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b140038e0 0x7f9b14003cf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800c5f0 tx=0x7f9b2806a640 comp rx=0 tx=0).stop 2022-03-21T13:54:53.560 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.547+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/449051091 shutdown_connections 2022-03-21T13:54:53.560 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.547+0000 7f9b2fb2a700 1 --2- 172.21.15.160:0/449051091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b140038e0 0x7f9b14003cf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.560 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.547+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/449051091 >> 172.21.15.160:0/449051091 conn(0x7f9b28068650 msgr2=0x7f9b280cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:53.561 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.547+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/449051091 shutdown_connections 2022-03-21T13:54:53.561 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.547+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/449051091 wait complete. 2022-03-21T13:54:53.561 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.548+0000 7f9b2fb2a700 1 Processor -- start 2022-03-21T13:54:53.561 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.548+0000 7f9b2fb2a700 1 -- start start 2022-03-21T13:54:53.561 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2fb2a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b140038e0 0x7f9b280bf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.562 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2fb2a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b28168b00 0x7f9b2806c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.562 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2fb2a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b280a8ef0 0x7f9b280a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.562 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2fb2a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280a98a0 con 0x7f9b28168b00 2022-03-21T13:54:53.562 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2fb2a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b28158360 con 0x7f9b280a8ef0 2022-03-21T13:54:53.562 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2fb2a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b28158600 con 0x7f9b140038e0 2022-03-21T13:54:53.563 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2d0c5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b28168b00 0x7f9b2806c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.563 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2d0c5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b28168b00 0x7f9b2806c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57014/0 (socket says 172.21.15.160:57014) 2022-03-21T13:54:53.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2d0c5700 1 -- 172.21.15.160:0/1162821306 learned_addr learned my addr 172.21.15.160:0/1162821306 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:53.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2e0c7700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b280a8ef0 0x7f9b280a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2d8c6700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b140038e0 0x7f9b280bf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2d0c5700 1 -- 172.21.15.160:0/1162821306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b140038e0 msgr2=0x7f9b280bf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2d0c5700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b140038e0 0x7f9b280bf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2d0c5700 1 -- 172.21.15.160:0/1162821306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b280a8ef0 msgr2=0x7f9b280a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2d0c5700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b280a8ef0 0x7f9b280a9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2d0c5700 1 -- 172.21.15.160:0/1162821306 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b281588e0 con 0x7f9b28168b00 2022-03-21T13:54:53.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2d0c5700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b28168b00 0x7f9b2806c980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0116e0 tx=0x7f9b1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:53.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b25ffb700 1 -- 172.21.15.160:0/1162821306 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c015670 con 0x7f9b28168b00 2022-03-21T13:54:53.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b25ffb700 1 -- 172.21.15.160:0/1162821306 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c0157d0 con 0x7f9b28168b00 2022-03-21T13:54:53.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/1162821306 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b28158bc0 con 0x7f9b28168b00 2022-03-21T13:54:53.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b25ffb700 1 -- 172.21.15.160:0/1162821306 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c015b50 con 0x7f9b28168b00 2022-03-21T13:54:53.566 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/1162821306 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b280bf870 con 0x7f9b28168b00 2022-03-21T13:54:53.568 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.550+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/1162821306 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2806fc00 con 0x7f9b28168b00 2022-03-21T13:54:53.568 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.551+0000 7f9b25ffb700 1 -- 172.21.15.160:0/1162821306 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f9b1c012040 con 0x7f9b28168b00 2022-03-21T13:54:53.568 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.551+0000 7f9b25ffb700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9b08063d10 0x7f9b080661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:53.568 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.551+0000 7f9b25ffb700 1 -- 172.21.15.160:0/1162821306 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b1c080c30 con 0x7f9b28168b00 2022-03-21T13:54:53.568 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.551+0000 7f9b2d8c6700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9b08063d10 0x7f9b080661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:53.569 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.551+0000 7f9b2d8c6700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9b08063d10 0x7f9b080661c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9b18008fd0 tx=0x7f9b18015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:53.569 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.556+0000 7f9b25ffb700 1 -- 172.21.15.160:0/1162821306 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f9b1c04f8d0 con 0x7f9b28168b00 2022-03-21T13:54:53.762 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.761+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/1162821306 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b2806bbe0 con 0x7f9b28168b00 2022-03-21T13:54:53.763 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.761+0000 7f9b25ffb700 1 -- 172.21.15.160:0/1162821306 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+6180 (secure 0 0 0) 0x7f9b1c052ef0 con 0x7f9b28168b00 2022-03-21T13:54:53.763 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:53.764 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1715710880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1715710880},{"type":"v1","addr":"172.21.15.160:6835","nonce":1715710880}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-03-21T13:54:27.533757+0000","modified":"2022-03-21T13:54:50.284369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4293,"mds_2":4288,"mds_3":4284,"mds_4":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":4,"incarnation":16,"state":"up:creating","state_seq":1,"addr":"172.21.15.171:6833/307954587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":307954587},{"type":"v1","addr":"172.21.15.171:6833","nonce":307954587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4284":{"gid":4284,"name":"a","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.160:6837/3534006535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3534006535},{"type":"v1","addr":"172.21.15.160:6837","nonce":3534006535}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.171:6835/826342148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":826342148},{"type":"v1","addr":"172.21.15.171:6835","nonce":826342148}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4293":{"gid":4293,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":5,"addr":"172.21.15.160:6839/4108285334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":4108285334},{"type":"v1","addr":"172.21.15.160:6839","nonce":4108285334}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.171:6837/4225939003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4225939003},{"type":"v1","addr":"172.21.15.171:6837","nonce":4225939003}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-03-21T13:54:53.765 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/1162821306 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9b08063d10 msgr2=0x7f9b080661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.765 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9b08063d10 0x7f9b080661c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9b18008fd0 tx=0x7f9b18015000 comp rx=0 tx=0).stop 2022-03-21T13:54:53.766 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/1162821306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b28168b00 msgr2=0x7f9b2806c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:53.766 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b28168b00 0x7f9b2806c980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0116e0 tx=0x7f9b1c008040 comp rx=0 tx=0).stop 2022-03-21T13:54:53.766 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/1162821306 shutdown_connections 2022-03-21T13:54:53.766 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9b08063d10 0x7f9b080661c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.767 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b280a8ef0 0x7f9b280a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.767 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b140038e0 0x7f9b280bf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.767 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 --2- 172.21.15.160:0/1162821306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b28168b00 0x7f9b2806c980 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:53.767 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/1162821306 >> 172.21.15.160:0/1162821306 conn(0x7f9b28068650 msgr2=0x7f9b281555d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:53.768 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/1162821306 shutdown_connections 2022-03-21T13:54:53.768 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:53.763+0000 7f9b2fb2a700 1 -- 172.21.15.160:0/1162821306 wait complete. 2022-03-21T13:54:53.768 INFO:teuthology.orchestra.run.smithi160.stderr:dumped fsmap epoch 16 2022-03-21T13:54:54.380 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-03-21T13:54:27.533757+0000', 'modified': '2022-03-21T13:54:50.284369+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4294, 'mds_1': 4293, 'mds_2': 4288, 'mds_3': 4284, 'mds_4': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'b', 'rank': 4, 'incarnation': 16, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.171:6833/307954587', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 307954587}, {'type': 'v1', 'addr': '172.21.15.171:6833', 'nonce': 307954587}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.160:6837/3534006535', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 3534006535}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 3534006535}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4288': {'gid': 4288, 'name': 'd', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.171:6835/826342148', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 826342148}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 826342148}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4293': {'gid': 4293, 'name': 'e', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.160:6839/4108285334', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 4108285334}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 4108285334}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4294': {'gid': 4294, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.171:6837/4225939003', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 4225939003}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 4225939003}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-03-21T13:54:54.380 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4282:up:creating 2022-03-21T13:54:55.382 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-03-21T13:54:55.509 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.509+0000 7f9c7d09a700 1 Processor -- start 2022-03-21T13:54:55.510 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.509+0000 7f9c7d09a700 1 -- start start 2022-03-21T13:54:55.515 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c7d09a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9c78157640 0x7f9c78157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:55.516 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c7d09a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c78157a10 0x7f9c78158450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:55.516 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c7d09a700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9c780cbca0 0x7f9c7806ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:55.516 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c7d09a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7806baa0 con 0x7f9c78157640 2022-03-21T13:54:55.517 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c7d09a700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c78158e30 con 0x7f9c780cbca0 2022-03-21T13:54:55.517 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c7d09a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780c6d80 con 0x7f9c78157a10 2022-03-21T13:54:55.517 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c76d9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9c78157640 0x7f9c78157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:55.517 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c76d9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9c78157640 0x7f9c78157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57020/0 (socket says 172.21.15.160:57020) 2022-03-21T13:54:55.517 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c76d9d700 1 -- 172.21.15.160:0/527125229 learned_addr learned my addr 172.21.15.160:0/527125229 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:55.518 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c7759e700 1 --2- 172.21.15.160:0/527125229 >> v2:172.21.15.171:3300/0 conn(0x7f9c780cbca0 0x7f9c7806ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:55.518 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c7659c700 1 --2- 172.21.15.160:0/527125229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c78157a10 0x7f9c78158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:55.518 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c76d9d700 1 -- 172.21.15.160:0/527125229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c78157a10 msgr2=0x7f9c78158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:55.518 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c76d9d700 1 --2- 172.21.15.160:0/527125229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c78157a10 0x7f9c78158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.518 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c76d9d700 1 -- 172.21.15.160:0/527125229 >> v2:172.21.15.171:3300/0 conn(0x7f9c780cbca0 msgr2=0x7f9c7806ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:55.519 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c76d9d700 1 --2- 172.21.15.160:0/527125229 >> v2:172.21.15.171:3300/0 conn(0x7f9c780cbca0 0x7f9c7806ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.519 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c76d9d700 1 -- 172.21.15.160:0/527125229 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78158b50 con 0x7f9c78157640 2022-03-21T13:54:55.519 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c7759e700 1 --2- 172.21.15.160:0/527125229 >> v2:172.21.15.171:3300/0 conn(0x7f9c780cbca0 0x7f9c7806ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:55.519 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c7659c700 1 --2- 172.21.15.160:0/527125229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c78157a10 0x7f9c78158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:55.520 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c76d9d700 1 --2- 172.21.15.160:0/527125229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c78157640 0x7f9c78157f10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c780698f0 tx=0x7f9c680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa24437cdd32189 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:55.520 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c75d9b700 1 -- 172.21.15.160:0/527125229 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c68004030 con 0x7f9c78157640 2022-03-21T13:54:55.520 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c75d9b700 1 -- 172.21.15.160:0/527125229 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c680041d0 con 0x7f9c78157640 2022-03-21T13:54:55.520 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.510+0000 7f9c75d9b700 1 -- 172.21.15.160:0/527125229 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c68011630 con 0x7f9c78157640 2022-03-21T13:54:55.520 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.511+0000 7f9c7d09a700 1 -- 172.21.15.160:0/527125229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c78157640 msgr2=0x7f9c78157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:55.521 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.511+0000 7f9c7d09a700 1 --2- 172.21.15.160:0/527125229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c78157640 0x7f9c78157f10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c780698f0 tx=0x7f9c680090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.521 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.511+0000 7f9c7d09a700 1 -- 172.21.15.160:0/527125229 shutdown_connections 2022-03-21T13:54:55.521 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.511+0000 7f9c7d09a700 1 --2- 172.21.15.160:0/527125229 >> v2:172.21.15.171:3300/0 conn(0x7f9c780cbca0 0x7f9c7806ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.521 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.511+0000 7f9c7d09a700 1 --2- 172.21.15.160:0/527125229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c78157640 0x7f9c78157f10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.521 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.511+0000 7f9c7d09a700 1 --2- 172.21.15.160:0/527125229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c78157a10 0x7f9c78158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.522 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.511+0000 7f9c7d09a700 1 -- 172.21.15.160:0/527125229 >> 172.21.15.160:0/527125229 conn(0x7f9c78068620 msgr2=0x7f9c780cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:55.522 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.511+0000 7f9c7d09a700 1 -- 172.21.15.160:0/527125229 shutdown_connections 2022-03-21T13:54:55.522 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.511+0000 7f9c7d09a700 1 -- 172.21.15.160:0/527125229 wait complete. 2022-03-21T13:54:55.522 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.512+0000 7f9c7d09a700 1 Processor -- start 2022-03-21T13:54:55.522 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.512+0000 7f9c7d09a700 1 -- start start 2022-03-21T13:54:55.523 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7d09a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c780cbca0 0x7f9c780be210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:55.523 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7d09a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c78157640 0x7f9c780c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:55.523 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7d09a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c78157a10 0x7f9c780aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:55.523 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7d09a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780ad080 con 0x7f9c78157a10 2022-03-21T13:54:55.524 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7d09a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780aaac0 con 0x7f9c780cbca0 2022-03-21T13:54:55.524 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7d09a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780be8c0 con 0x7f9c78157640 2022-03-21T13:54:55.524 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7759e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c78157a10 0x7f9c780aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:55.524 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7759e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c78157a10 0x7f9c780aaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57030/0 (socket says 172.21.15.160:57030) 2022-03-21T13:54:55.524 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7759e700 1 -- 172.21.15.160:0/1492990276 learned_addr learned my addr 172.21.15.160:0/1492990276 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:55.525 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7659c700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c78157640 0x7f9c780c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:55.525 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c76d9d700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c780cbca0 0x7f9c780be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:55.525 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7759e700 1 -- 172.21.15.160:0/1492990276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c78157640 msgr2=0x7f9c780c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:55.525 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7759e700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c78157640 0x7f9c780c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.525 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7759e700 1 -- 172.21.15.160:0/1492990276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c780cbca0 msgr2=0x7f9c780be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:55.526 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7759e700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c780cbca0 0x7f9c780be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.526 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7759e700 1 -- 172.21.15.160:0/1492990276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68009370 con 0x7f9c78157a10 2022-03-21T13:54:55.526 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.513+0000 7f9c7759e700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c78157a10 0x7f9c780aaf50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009fc0 tx=0x7f9c700099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:55.526 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.514+0000 7f9c5effd700 1 -- 172.21.15.160:0/1492990276 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000dbe0 con 0x7f9c78157a10 2022-03-21T13:54:55.527 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.514+0000 7f9c5effd700 1 -- 172.21.15.160:0/1492990276 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7000f040 con 0x7f9c78157a10 2022-03-21T13:54:55.527 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.514+0000 7f9c5effd700 1 -- 172.21.15.160:0/1492990276 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70003860 con 0x7f9c78157a10 2022-03-21T13:54:55.527 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.514+0000 7f9c7d09a700 1 -- 172.21.15.160:0/1492990276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c780a9eb0 con 0x7f9c78157a10 2022-03-21T13:54:55.527 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.514+0000 7f9c7d09a700 1 -- 172.21.15.160:0/1492990276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c780aa470 con 0x7f9c78157a10 2022-03-21T13:54:55.527 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.515+0000 7f9c7d09a700 1 -- 172.21.15.160:0/1492990276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c78070ae0 con 0x7f9c78157a10 2022-03-21T13:54:55.528 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.515+0000 7f9c5effd700 1 -- 172.21.15.160:0/1492990276 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f9c7001c030 con 0x7f9c78157a10 2022-03-21T13:54:55.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.515+0000 7f9c5effd700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9c58063ce0 0x7f9c58066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:55.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.516+0000 7f9c76d9d700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9c58063ce0 0x7f9c58066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:55.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.516+0000 7f9c5effd700 1 -- 172.21.15.160:0/1492990276 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9c700808d0 con 0x7f9c78157a10 2022-03-21T13:54:55.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.516+0000 7f9c76d9d700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9c58063ce0 0x7f9c58066190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009340 tx=0x7f9c68016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:55.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.520+0000 7f9c5effd700 1 -- 172.21.15.160:0/1492990276 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f9c7004f4b0 con 0x7f9c78157a10 2022-03-21T13:54:55.726 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.725+0000 7f9c7d09a700 1 -- 172.21.15.160:0/1492990276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c780beb30 con 0x7f9c78157a10 2022-03-21T13:54:55.727 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.726+0000 7f9c5effd700 1 -- 172.21.15.160:0/1492990276 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+6180 (secure 0 0 0) 0x7f9c7001a070 con 0x7f9c78157a10 2022-03-21T13:54:55.727 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:55.727 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1715710880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1715710880},{"type":"v1","addr":"172.21.15.160:6835","nonce":1715710880}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-03-21T13:54:27.533757+0000","modified":"2022-03-21T13:54:50.284369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4293,"mds_2":4288,"mds_3":4284,"mds_4":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":4,"incarnation":16,"state":"up:creating","state_seq":1,"addr":"172.21.15.171:6833/307954587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":307954587},{"type":"v1","addr":"172.21.15.171:6833","nonce":307954587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4284":{"gid":4284,"name":"a","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.160:6837/3534006535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3534006535},{"type":"v1","addr":"172.21.15.160:6837","nonce":3534006535}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.171:6835/826342148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":826342148},{"type":"v1","addr":"172.21.15.171:6835","nonce":826342148}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4293":{"gid":4293,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":5,"addr":"172.21.15.160:6839/4108285334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":4108285334},{"type":"v1","addr":"172.21.15.160:6839","nonce":4108285334}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.171:6837/4225939003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4225939003},{"type":"v1","addr":"172.21.15.171:6837","nonce":4225939003}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-03-21T13:54:55.729 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 -- 172.21.15.160:0/1492990276 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9c58063ce0 msgr2=0x7f9c58066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:55.729 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9c58063ce0 0x7f9c58066190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009340 tx=0x7f9c68016000 comp rx=0 tx=0).stop 2022-03-21T13:54:55.729 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 -- 172.21.15.160:0/1492990276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c78157a10 msgr2=0x7f9c780aaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:55.730 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c78157a10 0x7f9c780aaf50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009fc0 tx=0x7f9c700099b0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.730 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 -- 172.21.15.160:0/1492990276 shutdown_connections 2022-03-21T13:54:55.730 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f9c58063ce0 0x7f9c58066190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.730 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c78157a10 0x7f9c780aaf50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.731 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c780cbca0 0x7f9c780be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.731 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 --2- 172.21.15.160:0/1492990276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c78157640 0x7f9c780c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:55.731 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 -- 172.21.15.160:0/1492990276 >> 172.21.15.160:0/1492990276 conn(0x7f9c78068620 msgr2=0x7f9c780c9750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:55.731 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 -- 172.21.15.160:0/1492990276 shutdown_connections 2022-03-21T13:54:55.731 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:55.728+0000 7f9c7d09a700 1 -- 172.21.15.160:0/1492990276 wait complete. 2022-03-21T13:54:55.732 INFO:teuthology.orchestra.run.smithi160.stderr:dumped fsmap epoch 16 2022-03-21T13:54:56.344 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-03-21T13:54:27.533757+0000', 'modified': '2022-03-21T13:54:50.284369+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4294, 'mds_1': 4293, 'mds_2': 4288, 'mds_3': 4284, 'mds_4': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'b', 'rank': 4, 'incarnation': 16, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.171:6833/307954587', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 307954587}, {'type': 'v1', 'addr': '172.21.15.171:6833', 'nonce': 307954587}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.160:6837/3534006535', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 3534006535}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 3534006535}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4288': {'gid': 4288, 'name': 'd', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.171:6835/826342148', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 826342148}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 826342148}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4293': {'gid': 4293, 'name': 'e', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.160:6839/4108285334', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 4108285334}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 4108285334}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4294': {'gid': 4294, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.171:6837/4225939003', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 4225939003}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 4225939003}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-03-21T13:54:56.345 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4282:up:creating 2022-03-21T13:54:57.346 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-03-21T13:54:57.472 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.472+0000 7f4f6adde700 1 Processor -- start 2022-03-21T13:54:57.473 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.472+0000 7f4f6adde700 1 -- start start 2022-03-21T13:54:57.475 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.472+0000 7f4f6adde700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4f64157640 0x7f4f64157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:57.476 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.472+0000 7f4f6adde700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4f6406d190 0x7f4f64158450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:57.476 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.472+0000 7f4f6adde700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f64158e30 con 0x7f4f64157a10 2022-03-21T13:54:57.476 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.472+0000 7f4f6adde700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6406baa0 con 0x7f4f6406d190 2022-03-21T13:54:57.476 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.472+0000 7f4f6adde700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f640c6d80 con 0x7f4f64157640 2022-03-21T13:54:57.477 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f6937b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4f6406d190 0x7f4f64158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:57.477 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f6937b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4f6406d190 0x7f4f64158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57044/0 (socket says 172.21.15.160:57044) 2022-03-21T13:54:57.477 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f6937b700 1 -- 172.21.15.160:0/2169291795 learned_addr learned my addr 172.21.15.160:0/2169291795 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:57.478 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f6937b700 1 -- 172.21.15.160:0/2169291795 >> v2:172.21.15.171:3300/0 conn(0x7f4f64157640 msgr2=0x7f4f64157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:57.478 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f68b7a700 1 --2- 172.21.15.160:0/2169291795 >> v2:172.21.15.171:3300/0 conn(0x7f4f64157640 0x7f4f64157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:57.478 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f6937b700 1 --2- 172.21.15.160:0/2169291795 >> v2:172.21.15.171:3300/0 conn(0x7f4f64157640 0x7f4f64157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:57.478 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f6937b700 1 -- 172.21.15.160:0/2169291795 >> v1:172.21.15.171:6789/0 conn(0x7f4f64157a10 legacy=0x7f4f6406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:57.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f6937b700 1 -- 172.21.15.160:0/2169291795 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f64158b50 con 0x7f4f6406d190 2022-03-21T13:54:57.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f6937b700 1 --2- 172.21.15.160:0/2169291795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f6406d190 0x7f4f64158450 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009f20 tx=0x7f4f5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4624ee6cacafbf69 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:57.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f637fe700 1 -- 172.21.15.160:0/2169291795 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00e070 con 0x7f4f6406d190 2022-03-21T13:54:57.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f637fe700 1 -- 172.21.15.160:0/2169291795 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c00ba00 con 0x7f4f6406d190 2022-03-21T13:54:57.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.473+0000 7f4f637fe700 1 -- 172.21.15.160:0/2169291795 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0092e0 con 0x7f4f6406d190 2022-03-21T13:54:57.480 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.474+0000 7f4f6adde700 1 -- 172.21.15.160:0/2169291795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f6406d190 msgr2=0x7f4f64158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:57.480 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.474+0000 7f4f6adde700 1 --2- 172.21.15.160:0/2169291795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f6406d190 0x7f4f64158450 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009f20 tx=0x7f4f5c009840 comp rx=0 tx=0).stop 2022-03-21T13:54:57.480 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.474+0000 7f4f6adde700 1 -- 172.21.15.160:0/2169291795 shutdown_connections 2022-03-21T13:54:57.481 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.474+0000 7f4f6adde700 1 --2- 172.21.15.160:0/2169291795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f6406d190 0x7f4f64158450 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:57.481 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.474+0000 7f4f6adde700 1 --2- 172.21.15.160:0/2169291795 >> v2:172.21.15.171:3300/0 conn(0x7f4f64157640 0x7f4f64157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:57.481 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.474+0000 7f4f6adde700 1 -- 172.21.15.160:0/2169291795 >> 172.21.15.160:0/2169291795 conn(0x7f4f64068620 msgr2=0x7f4f640cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:57.481 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.474+0000 7f4f6adde700 1 -- 172.21.15.160:0/2169291795 shutdown_connections 2022-03-21T13:54:57.481 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.474+0000 7f4f6adde700 1 -- 172.21.15.160:0/2169291795 wait complete. 2022-03-21T13:54:57.482 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.475+0000 7f4f6adde700 1 Processor -- start 2022-03-21T13:54:57.482 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.475+0000 7f4f6adde700 1 -- start start 2022-03-21T13:54:57.485 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6adde700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f6406d190 0x7f4f641689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:57.485 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6adde700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f64157640 0x7f4f640c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:57.485 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6adde700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64157a10 0x7f4f640c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:57.486 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6adde700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640aea10 con 0x7f4f64157a10 2022-03-21T13:54:57.486 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6adde700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f641657a0 con 0x7f4f64157640 2022-03-21T13:54:57.486 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6adde700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640c60f0 con 0x7f4f6406d190 2022-03-21T13:54:57.486 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6937b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64157a10 0x7f4f640c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:57.486 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6937b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64157a10 0x7f4f640c16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57050/0 (socket says 172.21.15.160:57050) 2022-03-21T13:54:57.487 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6937b700 1 -- 172.21.15.160:0/653467254 learned_addr learned my addr 172.21.15.160:0/653467254 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:57.487 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f63fff700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f64157640 0x7f4f640c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:57.487 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f68b7a700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f6406d190 0x7f4f641689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:57.487 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6937b700 1 -- 172.21.15.160:0/653467254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f6406d190 msgr2=0x7f4f641689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:57.487 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6937b700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f6406d190 0x7f4f641689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:57.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6937b700 1 -- 172.21.15.160:0/653467254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f64157640 msgr2=0x7f4f640c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:57.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6937b700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f64157640 0x7f4f640c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:57.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6937b700 1 -- 172.21.15.160:0/653467254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c009ae0 con 0x7f4f64157a10 2022-03-21T13:54:57.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6937b700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64157a10 0x7f4f640c16e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4f6405e4b0 tx=0x7f4f5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:57.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f60ff9700 1 -- 172.21.15.160:0/653467254 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c004240 con 0x7f4f64157a10 2022-03-21T13:54:57.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f60ff9700 1 -- 172.21.15.160:0/653467254 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c0043c0 con 0x7f4f64157a10 2022-03-21T13:54:57.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f6adde700 1 -- 172.21.15.160:0/653467254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f640c6310 con 0x7f4f64157a10 2022-03-21T13:54:57.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.476+0000 7f4f60ff9700 1 -- 172.21.15.160:0/653467254 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c004780 con 0x7f4f64157a10 2022-03-21T13:54:57.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.477+0000 7f4f6adde700 1 -- 172.21.15.160:0/653467254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f64164e00 con 0x7f4f64157a10 2022-03-21T13:54:57.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.478+0000 7f4f6adde700 1 -- 172.21.15.160:0/653467254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f641658e0 con 0x7f4f64157a10 2022-03-21T13:54:57.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.478+0000 7f4f60ff9700 1 -- 172.21.15.160:0/653467254 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f4f5c02c070 con 0x7f4f64157a10 2022-03-21T13:54:57.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.478+0000 7f4f60ff9700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4f44063d10 0x7f4f440661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:57.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.478+0000 7f4f60ff9700 1 -- 172.21.15.160:0/653467254 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f5c081c00 con 0x7f4f64157a10 2022-03-21T13:54:57.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.478+0000 7f4f68b7a700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4f44063d10 0x7f4f440661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:57.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.479+0000 7f4f68b7a700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4f44063d10 0x7f4f440661c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400ab30 tx=0x7f4f54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:57.491 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.482+0000 7f4f60ff9700 1 -- 172.21.15.160:0/653467254 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f4f641658e0 con 0x7f4f64157a10 2022-03-21T13:54:57.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.693+0000 7f4f6adde700 1 -- 172.21.15.160:0/653467254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f640c2290 con 0x7f4f64157a10 2022-03-21T13:54:57.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.693+0000 7f4f60ff9700 1 -- 172.21.15.160:0/653467254 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6179 (secure 0 0 0) 0x7f4f5c02a070 con 0x7f4f64157a10 2022-03-21T13:54:57.695 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-03-21T13:54:57.695 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1715710880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1715710880},{"type":"v1","addr":"172.21.15.160:6835","nonce":1715710880}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-03-21T13:54:27.533757+0000","modified":"2022-03-21T13:54:56.298108+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4293,"mds_2":4288,"mds_3":4284,"mds_4":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6833/307954587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":307954587},{"type":"v1","addr":"172.21.15.171:6833","nonce":307954587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4284":{"gid":4284,"name":"a","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.160:6837/3534006535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3534006535},{"type":"v1","addr":"172.21.15.160:6837","nonce":3534006535}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.171:6835/826342148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":826342148},{"type":"v1","addr":"172.21.15.171:6835","nonce":826342148}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4293":{"gid":4293,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":5,"addr":"172.21.15.160:6839/4108285334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":4108285334},{"type":"v1","addr":"172.21.15.160:6839","nonce":4108285334}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.171:6837/4225939003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4225939003},{"type":"v1","addr":"172.21.15.171:6837","nonce":4225939003}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-03-21T13:54:57.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 -- 172.21.15.160:0/653467254 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4f44063d10 msgr2=0x7f4f440661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:57.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4f44063d10 0x7f4f440661c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400ab30 tx=0x7f4f54008040 comp rx=0 tx=0).stop 2022-03-21T13:54:57.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 -- 172.21.15.160:0/653467254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64157a10 msgr2=0x7f4f640c16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:57.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64157a10 0x7f4f640c16e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4f6405e4b0 tx=0x7f4f5c017000 comp rx=0 tx=0).stop 2022-03-21T13:54:57.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 -- 172.21.15.160:0/653467254 shutdown_connections 2022-03-21T13:54:57.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4f44063d10 0x7f4f440661c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:57.697 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64157a10 0x7f4f640c16e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:57.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f6406d190 0x7f4f641689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:57.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 --2- 172.21.15.160:0/653467254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f64157640 0x7f4f640c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:57.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 -- 172.21.15.160:0/653467254 >> 172.21.15.160:0/653467254 conn(0x7f4f64068620 msgr2=0x7f4f640c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:57.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 -- 172.21.15.160:0/653467254 shutdown_connections 2022-03-21T13:54:57.698 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:57.695+0000 7f4f6adde700 1 -- 172.21.15.160:0/653467254 wait complete. 2022-03-21T13:54:57.699 INFO:teuthology.orchestra.run.smithi160.stderr:dumped fsmap epoch 17 2022-03-21T13:54:58.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-03-21T13:54:27.533757+0000', 'modified': '2022-03-21T13:54:56.298108+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4294, 'mds_1': 4293, 'mds_2': 4288, 'mds_3': 4284, 'mds_4': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'b', 'rank': 4, 'incarnation': 16, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.171:6833/307954587', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 307954587}, {'type': 'v1', 'addr': '172.21.15.171:6833', 'nonce': 307954587}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.160:6837/3534006535', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 3534006535}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 3534006535}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4288': {'gid': 4288, 'name': 'd', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.171:6835/826342148', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 826342148}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 826342148}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4293': {'gid': 4293, 'name': 'e', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.160:6839/4108285334', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 4108285334}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 4108285334}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4294': {'gid': 4294, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.171:6837/4225939003', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 4225939003}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 4225939003}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-03-21T13:54:58.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2022-03-21T13:54:58.312 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2022-03-21T13:54:58.427 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.427+0000 7effd768f700 1 Processor -- start 2022-03-21T13:54:58.428 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.427+0000 7effd768f700 1 -- start start 2022-03-21T13:54:58.433 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd768f700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7effd014cc30 0x7effd00c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.433 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd768f700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effd014d000 0x7effd00c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.433 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd768f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7effd00c4ce0 0x7effd0156000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.434 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd768f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd00c13c0 con 0x7effd00c4ce0 2022-03-21T13:54:58.434 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd768f700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd00c0310 con 0x7effd014cc30 2022-03-21T13:54:58.434 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd768f700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd00c39a0 con 0x7effd014d000 2022-03-21T13:54:58.434 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd5c2c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7effd00c4ce0 0x7effd0156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.435 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd5c2c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7effd00c4ce0 0x7effd0156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57058/0 (socket says 172.21.15.160:57058) 2022-03-21T13:54:58.435 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd5c2c700 1 -- 172.21.15.160:0/3052817273 learned_addr learned my addr 172.21.15.160:0/3052817273 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:58.435 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd4c2a700 1 --2- 172.21.15.160:0/3052817273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effd014d000 0x7effd00c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.435 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd542b700 1 --2- 172.21.15.160:0/3052817273 >> v2:172.21.15.171:3300/0 conn(0x7effd014cc30 0x7effd00c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.436 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd5c2c700 1 -- 172.21.15.160:0/3052817273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effd014d000 msgr2=0x7effd00c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:58.436 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd5c2c700 1 --2- 172.21.15.160:0/3052817273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effd014d000 0x7effd00c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.436 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd5c2c700 1 -- 172.21.15.160:0/3052817273 >> v2:172.21.15.171:3300/0 conn(0x7effd014cc30 msgr2=0x7effd00c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:58.436 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd5c2c700 1 --2- 172.21.15.160:0/3052817273 >> v2:172.21.15.171:3300/0 conn(0x7effd014cc30 0x7effd00c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.436 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd5c2c700 1 -- 172.21.15.160:0/3052817273 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd00c5140 con 0x7effd00c4ce0 2022-03-21T13:54:58.437 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd542b700 1 --2- 172.21.15.160:0/3052817273 >> v2:172.21.15.171:3300/0 conn(0x7effd014cc30 0x7effd00c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:58.437 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd4c2a700 1 --2- 172.21.15.160:0/3052817273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effd014d000 0x7effd00c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:58.437 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effd5c2c700 1 --2- 172.21.15.160:0/3052817273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effd00c4ce0 0x7effd0156000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7effd0069800 tx=0x7effc80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db6ac7e7114f4f9 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:58.437 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effcffff700 1 -- 172.21.15.160:0/3052817273 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8004030 con 0x7effd00c4ce0 2022-03-21T13:54:58.438 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effcffff700 1 -- 172.21.15.160:0/3052817273 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc80041d0 con 0x7effd00c4ce0 2022-03-21T13:54:58.438 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.428+0000 7effcffff700 1 -- 172.21.15.160:0/3052817273 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8011630 con 0x7effd00c4ce0 2022-03-21T13:54:58.438 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.429+0000 7effd768f700 1 -- 172.21.15.160:0/3052817273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effd00c4ce0 msgr2=0x7effd0156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:58.438 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.429+0000 7effd768f700 1 --2- 172.21.15.160:0/3052817273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effd00c4ce0 0x7effd0156000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7effd0069800 tx=0x7effc80090f0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.438 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.429+0000 7effd768f700 1 -- 172.21.15.160:0/3052817273 shutdown_connections 2022-03-21T13:54:58.439 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.429+0000 7effd768f700 1 --2- 172.21.15.160:0/3052817273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effd00c4ce0 0x7effd0156000 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.439 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.429+0000 7effd768f700 1 --2- 172.21.15.160:0/3052817273 >> v2:172.21.15.171:3300/0 conn(0x7effd014cc30 0x7effd00c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.439 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.429+0000 7effd768f700 1 --2- 172.21.15.160:0/3052817273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effd014d000 0x7effd00c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.439 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.429+0000 7effd768f700 1 -- 172.21.15.160:0/3052817273 >> 172.21.15.160:0/3052817273 conn(0x7effd00c98f0 msgr2=0x7effd00c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:58.439 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.429+0000 7effd768f700 1 -- 172.21.15.160:0/3052817273 shutdown_connections 2022-03-21T13:54:58.440 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.429+0000 7effd768f700 1 -- 172.21.15.160:0/3052817273 wait complete. 2022-03-21T13:54:58.440 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.430+0000 7effd768f700 1 Processor -- start 2022-03-21T13:54:58.440 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.430+0000 7effd768f700 1 -- start start 2022-03-21T13:54:58.440 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd768f700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effd00c4ce0 0x7effd00beef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.441 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd768f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effd014cc30 0x7effd014e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.441 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd768f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effd014d000 0x7effd014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.441 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd768f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd014fdd0 con 0x7effd014cc30 2022-03-21T13:54:58.441 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd768f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd014f1a0 con 0x7effd014d000 2022-03-21T13:54:58.441 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd768f700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd014d560 con 0x7effd00c4ce0 2022-03-21T13:54:58.442 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd4c2a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effd014cc30 0x7effd014e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.442 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd4c2a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effd014cc30 0x7effd014e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57062/0 (socket says 172.21.15.160:57062) 2022-03-21T13:54:58.442 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd4c2a700 1 -- 172.21.15.160:0/2459526827 learned_addr learned my addr 172.21.15.160:0/2459526827 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:58.442 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd542b700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effd00c4ce0 0x7effd00beef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.443 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd5c2c700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effd014d000 0x7effd014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.443 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd4c2a700 1 -- 172.21.15.160:0/2459526827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effd00c4ce0 msgr2=0x7effd00beef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:58.443 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd4c2a700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effd00c4ce0 0x7effd00beef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.443 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd4c2a700 1 -- 172.21.15.160:0/2459526827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effd014d000 msgr2=0x7effd014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:58.443 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd4c2a700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effd014d000 0x7effd014ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.444 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd4c2a700 1 -- 172.21.15.160:0/2459526827 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8009370 con 0x7effd014cc30 2022-03-21T13:54:58.444 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd5c2c700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effd014d000 0x7effd014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:58.444 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd4c2a700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effd014cc30 0x7effd014e720 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7effc400d890 tx=0x7effc4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:58.444 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effcd7fa700 1 -- 172.21.15.160:0/2459526827 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4004030 con 0x7effd014cc30 2022-03-21T13:54:58.445 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effcd7fa700 1 -- 172.21.15.160:0/2459526827 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc4004190 con 0x7effd014cc30 2022-03-21T13:54:58.445 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effcd7fa700 1 -- 172.21.15.160:0/2459526827 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4014620 con 0x7effd014cc30 2022-03-21T13:54:58.445 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.431+0000 7effd768f700 1 -- 172.21.15.160:0/2459526827 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd014d820 con 0x7effd014cc30 2022-03-21T13:54:58.445 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.432+0000 7effd768f700 1 -- 172.21.15.160:0/2459526827 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd00bcba0 con 0x7effd014cc30 2022-03-21T13:54:58.452 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.433+0000 7effcd7fa700 1 -- 172.21.15.160:0/2459526827 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7effc401a020 con 0x7effd014cc30 2022-03-21T13:54:58.452 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.433+0000 7effcd7fa700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7effb0063ce0 0x7effb0066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.452 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.433+0000 7effcd7fa700 1 -- 172.21.15.160:0/2459526827 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7effc4080ad0 con 0x7effd014cc30 2022-03-21T13:54:58.453 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.433+0000 7effd542b700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7effb0063ce0 0x7effb0066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.453 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.434+0000 7effd542b700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7effb0063ce0 0x7effb0066190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7effc0003c60 tx=0x7effc00099d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:58.453 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.435+0000 7effe1000b80 1 Processor -- start 2022-03-21T13:54:58.453 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.435+0000 7effe1000b80 1 -- start start 2022-03-21T13:54:58.454 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effe1000b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d62b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.454 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effe1000b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ba00 0x55b2f6d63050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.454 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effe1000b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6d75790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.454 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effe1000b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6cab240 con 0x55b2f6d2ad10 2022-03-21T13:54:58.454 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effe1000b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6bfb090 con 0x55b2f6d2ba00 2022-03-21T13:54:58.455 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effe1000b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6c80bf0 con 0x55b2f6d2b0e0 2022-03-21T13:54:58.455 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd542b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d62b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.455 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd542b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d62b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57068/0 (socket says 172.21.15.160:57068) 2022-03-21T13:54:58.455 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd542b700 1 -- 172.21.15.160:0/3579124171 learned_addr learned my addr 172.21.15.160:0/3579124171 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:58.456 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd4c2a700 1 --2- 172.21.15.160:0/3579124171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ba00 0x55b2f6d63050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.456 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd5c2c700 1 --2- 172.21.15.160:0/3579124171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6d75790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.456 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd542b700 1 -- 172.21.15.160:0/3579124171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 msgr2=0x55b2f6d75790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:58.456 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd542b700 1 --2- 172.21.15.160:0/3579124171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6d75790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.456 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd542b700 1 -- 172.21.15.160:0/3579124171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ba00 msgr2=0x55b2f6d63050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:58.457 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd542b700 1 --2- 172.21.15.160:0/3579124171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ba00 0x55b2f6d63050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.457 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd542b700 1 -- 172.21.15.160:0/3579124171 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2f6b11360 con 0x55b2f6d2ad10 2022-03-21T13:54:58.457 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd4c2a700 1 --2- 172.21.15.160:0/3579124171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ba00 0x55b2f6d63050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:54:58.457 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.436+0000 7effd542b700 1 --2- 172.21.15.160:0/3579124171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d62b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7effc0015680 tx=0x7effc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78202cb730309702 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:58.458 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effb67fc700 1 -- 172.21.15.160:0/3579124171 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0009c90 con 0x55b2f6d2ad10 2022-03-21T13:54:58.458 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effb67fc700 1 -- 172.21.15.160:0/3579124171 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc001a070 con 0x55b2f6d2ad10 2022-03-21T13:54:58.458 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effb67fc700 1 -- 172.21.15.160:0/3579124171 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00168e0 con 0x55b2f6d2ad10 2022-03-21T13:54:58.458 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effe1000b80 1 -- 172.21.15.160:0/3579124171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 msgr2=0x55b2f6d62b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:54:58.458 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effe1000b80 1 --2- 172.21.15.160:0/3579124171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d62b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7effc0015680 tx=0x7effc0017000 comp rx=0 tx=0).stop 2022-03-21T13:54:58.459 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effe1000b80 1 -- 172.21.15.160:0/3579124171 shutdown_connections 2022-03-21T13:54:58.459 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effe1000b80 1 --2- 172.21.15.160:0/3579124171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6d75790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.459 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effe1000b80 1 --2- 172.21.15.160:0/3579124171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d62b10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.459 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effe1000b80 1 --2- 172.21.15.160:0/3579124171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ba00 0x55b2f6d63050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.460 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effe1000b80 1 -- 172.21.15.160:0/3579124171 >> 172.21.15.160:0/3579124171 conn(0x55b2f6d2a770 msgr2=0x55b2f6d70230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:54:58.460 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effe1000b80 1 -- 172.21.15.160:0/3579124171 shutdown_connections 2022-03-21T13:54:58.460 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.437+0000 7effe1000b80 1 -- 172.21.15.160:0/3579124171 wait complete. 2022-03-21T13:54:58.460 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.438+0000 7effe1000b80 1 -- start start 2022-03-21T13:54:58.460 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.438+0000 7effe1000b80 1 Processor -- start 2022-03-21T13:54:58.461 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effe1000b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d6d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.461 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effe1000b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6d64070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.461 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effe1000b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ba00 0x55b2f6d7fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.461 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effe1000b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6c7acd0 con 0x55b2f6d2ad10 2022-03-21T13:54:58.462 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effe1000b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6b13650 con 0x55b2f6d2ba00 2022-03-21T13:54:58.462 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effe1000b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6d701c0 con 0x55b2f6d2b0e0 2022-03-21T13:54:58.462 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effe1000b80 10 client.0 _ll_register_callbacks cb 0x55b2f6a8c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-21T13:54:58.462 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effd542b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d6d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.462 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effd542b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d6d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57074/0 (socket says 172.21.15.160:57074) 2022-03-21T13:54:58.463 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effd542b700 1 -- 172.21.15.160:0/2597208998 learned_addr learned my addr 172.21.15.160:0/2597208998 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:54:58.463 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effd4c2a700 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6d64070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.463 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effd5c2c700 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ba00 0x55b2f6d7fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.463 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effd542b700 1 -- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 msgr2=0x55b2f6d64070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:58.464 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effd542b700 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6d64070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.464 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effd542b700 1 -- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ba00 msgr2=0x55b2f6d7fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:54:58.464 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effd542b700 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ba00 0x55b2f6d7fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:54:58.464 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effd542b700 1 -- 172.21.15.160:0/2597208998 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc0003e40 con 0x55b2f6d2ad10 2022-03-21T13:54:58.464 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effd542b700 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d6d0b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7effc0023040 tx=0x7effc001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd032c4dc2c3d7a server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:54:58.465 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2022-03-21T13:54:58.465 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effab7fe700 1 -- 172.21.15.160:0/2597208998 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0021650 con 0x55b2f6d2ad10 2022-03-21T13:54:58.465 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effab7fe700 1 -- 172.21.15.160:0/2597208998 <== mon.0 v2:172.21.15.160:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7effc0031070 con 0x55b2f6d2ad10 2022-03-21T13:54:58.465 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.439+0000 7effe1000b80 1 -- 172.21.15.160:0/2597208998 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2f6d1fa80 con 0x55b2f6d2ad10 2022-03-21T13:54:58.466 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effab7fe700 1 -- 172.21.15.160:0/2597208998 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7effc00219c0 con 0x55b2f6d2ad10 2022-03-21T13:54:58.466 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effe1000b80 10 client.4656 fetch_fsmap learned FSMap version 17 2022-03-21T13:54:58.466 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effe1000b80 1 -- 172.21.15.160:0/2597208998 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b2f6abbfe0 con 0x55b2f6d2ad10 2022-03-21T13:54:58.466 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effab7fe700 1 -- 172.21.15.160:0/2597208998 <== mon.0 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b2f6d1fa80 con 0x55b2f6d2ad10 2022-03-21T13:54:58.467 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effab7fe700 1 -- 172.21.15.160:0/2597208998 <== mon.0 v2:172.21.15.160:3300/0 5 ==== fsmap(e 17) v1 ==== 4238+0+0 (secure 0 0 0) 0x7effc0021b20 con 0x55b2f6d2ad10 2022-03-21T13:54:58.467 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effe1000b80 10 client.4656 fetch_fsmap finished waiting for FSMap version 17 2022-03-21T13:54:58.467 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effe1000b80 10 client.4656 resolve_mds: resolved name 'b' to daemon mds.b 2022-03-21T13:54:58.467 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effe1000b80 20 client.4656 populate_metadata read hostname 'smithi160' 2022-03-21T13:54:58.467 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effe1000b80 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:6832/307954587,v1:172.21.15.171:6833/307954587] conn(0x55b2f6d7c230 0x55b2f6d7c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:54:58.468 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effe1000b80 4 client.4656 mds_command: new command op to 4282 tid=0[{"prefix": "get_command_descriptions"}] 2022-03-21T13:54:58.468 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effe1000b80 1 -- 172.21.15.160:0/2597208998 --> [v2:172.21.15.171:6832/307954587,v1:172.21.15.171:6833/307954587] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2f6cfc600 con 0x55b2f6d7c230 2022-03-21T13:54:58.468 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effd4c2a700 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:6832/307954587,v1:172.21.15.171:6833/307954587] conn(0x55b2f6d7c230 0x55b2f6d7c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:54:58.468 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effab7fe700 10 client.4656 ms_handle_connect on v2:172.21.15.171:6832/307954587 2022-03-21T13:54:58.468 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:54:58.440+0000 7effd4c2a700 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:6832/307954587,v1:172.21.15.171:6833/307954587] conn(0x55b2f6d7c230 0x55b2f6d7c600 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=919ef269ee00b18e server_cookie=21ef078b1ff4f549 in_seq=0 out_seq=0 2022-03-21T13:55:01.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.304+0000 7effab7fe700 1 -- 172.21.15.160:0/2597208998 <== mds.4 v2:172.21.15.171:6832/307954587 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x55b2f6cfc600 con 0x55b2f6d7c230 2022-03-21T13:55:01.306 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.304+0000 7effab7fe700 10 client.4656 handle_command_reply: tid=0 2022-03-21T13:55:01.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.304+0000 7effe1000b80 1 client.4656 shutdown 2022-03-21T13:55:01.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effe1000b80 1 -- 172.21.15.160:0/2597208998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 msgr2=0x55b2f6d6d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effe1000b80 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d6d0b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7effc0023040 tx=0x7effc001a000 comp rx=0 tx=0).stop 2022-03-21T13:55:01.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effe1000b80 1 -- 172.21.15.160:0/2597208998 shutdown_connections 2022-03-21T13:55:01.307 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effe1000b80 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:6832/307954587,v1:172.21.15.171:6833/307954587] conn(0x55b2f6d7c230 0x55b2f6d7c600 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effe1000b80 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ba00 0x55b2f6d7fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effe1000b80 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d6d0b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effab7fe700 0 client.4656 ms_handle_reset on v2:172.21.15.171:6832/307954587 2022-03-21T13:55:01.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effe1000b80 1 --2- 172.21.15.160:0/2597208998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6d64070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.308 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effe1000b80 1 -- 172.21.15.160:0/2597208998 >> 172.21.15.160:0/2597208998 conn(0x55b2f6d2a770 msgr2=0x55b2f6d2e260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effe1000b80 1 -- 172.21.15.160:0/2597208998 shutdown_connections 2022-03-21T13:55:01.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effe1000b80 1 -- 172.21.15.160:0/2597208998 wait complete. 2022-03-21T13:55:01.309 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.305+0000 7effe1000b80 20 client.4656 trim_cache size 0 max 16384 2022-03-21T13:55:01.325 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.324+0000 7effe1000b80 1 Processor -- start 2022-03-21T13:55:01.325 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.324+0000 7effe1000b80 1 -- start start 2022-03-21T13:55:01.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effe1000b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2a770 0x55b2f6d271c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effe1000b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d7c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effe1000b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2b0e0 0x55b2f6d7cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effe1000b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6d70300 con 0x55b2f6d2b0e0 2022-03-21T13:55:01.328 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effe1000b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6d2a4c0 con 0x55b2f6d2ad10 2022-03-21T13:55:01.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effe1000b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6d2b550 con 0x55b2f6d2a770 2022-03-21T13:55:01.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effd5c2c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2b0e0 0x55b2f6d7cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effd5c2c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2b0e0 0x55b2f6d7cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57082/0 (socket says 172.21.15.160:57082) 2022-03-21T13:55:01.329 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effd5c2c700 1 -- 172.21.15.160:0/2642304189 learned_addr learned my addr 172.21.15.160:0/2642304189 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effd4c2a700 1 --2- 172.21.15.160:0/2642304189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d7c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effd542b700 1 --2- 172.21.15.160:0/2642304189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2a770 0x55b2f6d271c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effd5c2c700 1 -- 172.21.15.160:0/2642304189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2a770 msgr2=0x55b2f6d271c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.330 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effd5c2c700 1 --2- 172.21.15.160:0/2642304189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2a770 0x55b2f6d271c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effd5c2c700 1 -- 172.21.15.160:0/2642304189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ad10 msgr2=0x55b2f6d7c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effd5c2c700 1 --2- 172.21.15.160:0/2642304189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d7c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.325+0000 7effd5c2c700 1 -- 172.21.15.160:0/2642304189 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2f6ae3f80 con 0x55b2f6d2b0e0 2022-03-21T13:55:01.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.326+0000 7effd5c2c700 1 --2- 172.21.15.160:0/2642304189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2b0e0 0x55b2f6d7cb40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7effc8004000 tx=0x7effc8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06156444b4bc602 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.331 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.326+0000 7effb6ffd700 1 -- 172.21.15.160:0/2642304189 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8004030 con 0x55b2f6d2b0e0 2022-03-21T13:55:01.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.326+0000 7effb6ffd700 1 -- 172.21.15.160:0/2642304189 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc8022040 con 0x55b2f6d2b0e0 2022-03-21T13:55:01.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.326+0000 7effb6ffd700 1 -- 172.21.15.160:0/2642304189 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8004340 con 0x55b2f6d2b0e0 2022-03-21T13:55:01.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.327+0000 7effe1000b80 1 -- 172.21.15.160:0/2642304189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2b0e0 msgr2=0x55b2f6d7cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.327+0000 7effe1000b80 1 --2- 172.21.15.160:0/2642304189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2b0e0 0x55b2f6d7cb40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7effc8004000 tx=0x7effc8016000 comp rx=0 tx=0).stop 2022-03-21T13:55:01.332 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.327+0000 7effe1000b80 1 -- 172.21.15.160:0/2642304189 shutdown_connections 2022-03-21T13:55:01.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.327+0000 7effe1000b80 1 --2- 172.21.15.160:0/2642304189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2b0e0 0x55b2f6d7cb40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.327+0000 7effe1000b80 1 --2- 172.21.15.160:0/2642304189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2a770 0x55b2f6d271c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.327+0000 7effe1000b80 1 --2- 172.21.15.160:0/2642304189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2ad10 0x55b2f6d7c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.327+0000 7effe1000b80 1 -- 172.21.15.160:0/2642304189 >> 172.21.15.160:0/2642304189 conn(0x55b2f6d7f120 msgr2=0x55b2f6d69ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.333 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.327+0000 7effe1000b80 1 -- 172.21.15.160:0/2642304189 shutdown_connections 2022-03-21T13:55:01.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.327+0000 7effe1000b80 1 -- 172.21.15.160:0/2642304189 wait complete. 2022-03-21T13:55:01.334 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.327+0000 7effe1000b80 1 -- start start 2022-03-21T13:55:01.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.328+0000 7effe1000b80 1 Processor -- start 2022-03-21T13:55:01.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.328+0000 7effe1000b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2a770 0x55b2f6d69060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.328+0000 7effe1000b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6dd53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.339 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.328+0000 7effe1000b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6dcb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.328+0000 7effe1000b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6dd5db0 con 0x55b2f6d2ad10 2022-03-21T13:55:01.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.328+0000 7effe1000b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6d1fa00 con 0x55b2f6d2a770 2022-03-21T13:55:01.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.328+0000 7effe1000b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2f6dd4f00 con 0x55b2f6d2b0e0 2022-03-21T13:55:01.340 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.328+0000 7effe1000b80 10 client.0 _ll_register_callbacks cb 0x55b2f6a8c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-21T13:55:01.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.328+0000 7effd4c2a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6dd53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effd4c2a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6dd53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57086/0 (socket says 172.21.15.160:57086) 2022-03-21T13:55:01.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effd4c2a700 1 -- 172.21.15.160:0/1048308026 learned_addr learned my addr 172.21.15.160:0/1048308026 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effd542b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2a770 0x55b2f6d69060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.341 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effd5c2c700 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6dcb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effd4c2a700 1 -- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 msgr2=0x55b2f6dcb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effd4c2a700 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6dcb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effd4c2a700 1 -- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2a770 msgr2=0x55b2f6d69060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effd4c2a700 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2a770 0x55b2f6d69060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.342 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effd4c2a700 1 -- 172.21.15.160:0/1048308026 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd00c5140 con 0x55b2f6d2ad10 2022-03-21T13:55:01.343 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effd542b700 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2a770 0x55b2f6d69060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:55:01.343 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effd4c2a700 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6dd53a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7effc407f1a0 tx=0x7effc4055040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f7818ab6d7f787 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.344 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2022-03-21T13:55:01.344 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effab7fe700 1 -- 172.21.15.160:0/1048308026 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc407ed00 con 0x55b2f6d2ad10 2022-03-21T13:55:01.344 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effab7fe700 1 -- 172.21.15.160:0/1048308026 <== mon.0 v2:172.21.15.160:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7effc407ee60 con 0x55b2f6d2ad10 2022-03-21T13:55:01.344 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effe1000b80 1 -- 172.21.15.160:0/1048308026 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7effc001a070 con 0x55b2f6d2ad10 2022-03-21T13:55:01.345 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effab7fe700 1 -- 172.21.15.160:0/1048308026 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7effc406e250 con 0x55b2f6d2ad10 2022-03-21T13:55:01.345 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effe1000b80 10 client.4662 fetch_fsmap learned FSMap version 17 2022-03-21T13:55:01.345 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.329+0000 7effe1000b80 1 -- 172.21.15.160:0/1048308026 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b2f6abdb10 con 0x55b2f6d2ad10 2022-03-21T13:55:01.345 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.330+0000 7effab7fe700 1 -- 172.21.15.160:0/1048308026 <== mon.0 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc001a070 con 0x55b2f6d2ad10 2022-03-21T13:55:01.345 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.330+0000 7effab7fe700 1 -- 172.21.15.160:0/1048308026 <== mon.0 v2:172.21.15.160:3300/0 5 ==== fsmap(e 17) v1 ==== 4238+0+0 (secure 0 0 0) 0x7effc4052860 con 0x55b2f6d2ad10 2022-03-21T13:55:01.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.330+0000 7effe1000b80 10 client.4662 fetch_fsmap finished waiting for FSMap version 17 2022-03-21T13:55:01.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.330+0000 7effe1000b80 10 client.4662 resolve_mds: resolved name 'b' to daemon mds.b 2022-03-21T13:55:01.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.330+0000 7effe1000b80 20 client.4662 populate_metadata read hostname 'smithi160' 2022-03-21T13:55:01.346 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.330+0000 7effe1000b80 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:6832/307954587,v1:172.21.15.171:6833/307954587] conn(0x55b2f6d2ba00 0x55b2f6d25c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.330+0000 7effe1000b80 4 client.4662 mds_command: new command op to 4282 tid=0[{"prefix": "status"}] 2022-03-21T13:55:01.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.330+0000 7effe1000b80 1 -- 172.21.15.160:0/1048308026 --> [v2:172.21.15.171:6832/307954587,v1:172.21.15.171:6833/307954587] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b2f6c385f0 con 0x55b2f6d2ba00 2022-03-21T13:55:01.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.330+0000 7effd542b700 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:6832/307954587,v1:172.21.15.171:6833/307954587] conn(0x55b2f6d2ba00 0x55b2f6d25c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.330+0000 7effab7fe700 10 client.4662 ms_handle_connect on v2:172.21.15.171:6832/307954587 2022-03-21T13:55:01.347 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.330+0000 7effd542b700 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:6832/307954587,v1:172.21.15.171:6833/307954587] conn(0x55b2f6d2ba00 0x55b2f6d25c50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ef0919dec0e21d24 server_cookie=db676cddd89e83b7 in_seq=0 out_seq=0 2022-03-21T13:55:01.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effab7fe700 1 -- 172.21.15.160:0/1048308026 <== mds.4 v2:172.21.15.171:6832/307954587 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55b2f6c385f0 con 0x55b2f6d2ba00 2022-03-21T13:55:01.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effab7fe700 10 client.4662 handle_command_reply: tid=0 2022-03-21T13:55:01.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 1 client.4662 shutdown 2022-03-21T13:55:01.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 1 -- 172.21.15.160:0/1048308026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 msgr2=0x55b2f6dd53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.348 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6dd53a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7effc407f1a0 tx=0x7effc4055040 comp rx=0 tx=0).stop 2022-03-21T13:55:01.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 1 -- 172.21.15.160:0/1048308026 shutdown_connections 2022-03-21T13:55:01.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:6832/307954587,v1:172.21.15.171:6833/307954587] conn(0x55b2f6d2ba00 0x55b2f6d25c50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b2f6d2b0e0 0x55b2f6dcb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.349 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2f6d2a770 0x55b2f6d69060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effab7fe700 0 client.4662 ms_handle_reset on v2:172.21.15.171:6832/307954587 2022-03-21T13:55:01.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 1 --2- 172.21.15.160:0/1048308026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b2f6d2ad10 0x55b2f6dd53a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 1 -- 172.21.15.160:0/1048308026 >> 172.21.15.160:0/1048308026 conn(0x55b2f6d7f120 msgr2=0x55b2f6d69f20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 1 -- 172.21.15.160:0/1048308026 shutdown_connections 2022-03-21T13:55:01.350 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 1 -- 172.21.15.160:0/1048308026 wait complete. 2022-03-21T13:55:01.351 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.331+0000 7effe1000b80 20 client.4662 trim_cache size 0 max 16384 2022-03-21T13:55:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2022-03-21T13:55:01.351 INFO:teuthology.orchestra.run.smithi160.stdout: "cluster_fsid": "b2a3ddc8-064e-4cc9-8187-33ea19afd50a", 2022-03-21T13:55:01.352 INFO:teuthology.orchestra.run.smithi160.stdout: "whoami": 4, 2022-03-21T13:55:01.352 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 4282, 2022-03-21T13:55:01.352 INFO:teuthology.orchestra.run.smithi160.stdout: "want_state": "up:active", 2022-03-21T13:55:01.352 INFO:teuthology.orchestra.run.smithi160.stdout: "state": "up:active", 2022-03-21T13:55:01.352 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs", 2022-03-21T13:55:01.353 INFO:teuthology.orchestra.run.smithi160.stdout: "rank_uptime": 11.042903373, 2022-03-21T13:55:01.353 INFO:teuthology.orchestra.run.smithi160.stdout: "mdsmap_epoch": 17, 2022-03-21T13:55:01.353 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_epoch": 20, 2022-03-21T13:55:01.353 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_epoch_barrier": 20, 2022-03-21T13:55:01.353 INFO:teuthology.orchestra.run.smithi160.stdout: "uptime": 38.702461782999997 2022-03-21T13:55:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:} 2022-03-21T13:55:01.355 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 -- 172.21.15.160:0/2459526827 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7effb0063ce0 msgr2=0x7effb0066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7effb0063ce0 0x7effb0066190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7effc0003c60 tx=0x7effc00099d0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 -- 172.21.15.160:0/2459526827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effd014cc30 msgr2=0x7effd014e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effd014cc30 0x7effd014e720 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7effc400d890 tx=0x7effc4008040 comp rx=0 tx=0).stop 2022-03-21T13:55:01.356 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 -- 172.21.15.160:0/2459526827 shutdown_connections 2022-03-21T13:55:01.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7effb0063ce0 0x7effb0066190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effd014d000 0x7effd014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effd00c4ce0 0x7effd00beef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 --2- 172.21.15.160:0/2459526827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effd014cc30 0x7effd014e720 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.357 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 -- 172.21.15.160:0/2459526827 >> 172.21.15.160:0/2459526827 conn(0x7effd00c98f0 msgr2=0x7effd00c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 -- 172.21.15.160:0/2459526827 shutdown_connections 2022-03-21T13:55:01.358 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.332+0000 7effd768f700 1 -- 172.21.15.160:0/2459526827 wait complete. 2022-03-21T13:55:01.358 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2022-03-21T13:55:01.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.478+0000 7fccf2e8c700 1 Processor -- start 2022-03-21T13:55:01.479 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.478+0000 7fccf2e8c700 1 -- start start 2022-03-21T13:55:01.487 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.479+0000 7fccf2e8c700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fccec158620 0x7fccec06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.479+0000 7fccf2e8c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec158e30 con 0x7fccec157a10 2022-03-21T13:55:01.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.479+0000 7fccf2e8c700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec0c6d80 con 0x7fccec157640 2022-03-21T13:55:01.488 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.479+0000 7fccf2e8c700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccec06baa0 con 0x7fccec158620 2022-03-21T13:55:01.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.479+0000 7fccf1429700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fccec157a10 0x7fccec15f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:60250/0 (socket says 172.21.15.160:60250) 2022-03-21T13:55:01.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.479+0000 7fccf1429700 1 -- 172.21.15.160:0/3605592690 learned_addr learned my addr 172.21.15.160:0/3605592690 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:55:01.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.479+0000 7fccebfff700 1 --2- 172.21.15.160:0/3605592690 >> v2:172.21.15.171:3300/0 conn(0x7fccec158620 0x7fccec06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.489 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.479+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885622765 0 0) 0x7fccec158e30 con 0x7fccec157a10 2022-03-21T13:55:01.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.479+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcccc0033f0 con 0x7fccec157a10 2022-03-21T13:55:01.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 <== mon.0 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2118358255 0 0) 0x7fcccc0033f0 con 0x7fccec157a10 2022-03-21T13:55:01.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 >> v2:172.21.15.171:3300/0 conn(0x7fccec158620 msgr2=0x7fccec06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.490 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 --2- 172.21.15.160:0/3605592690 >> v2:172.21.15.171:3300/0 conn(0x7fccec158620 0x7fccec06ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.491 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 >> v1:172.21.15.171:6789/0 conn(0x7fccec157640 legacy=0x7fccec157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.491 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec158b50 con 0x7fccec157a10 2022-03-21T13:55:01.491 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 <== mon.0 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 909237311 0 0) 0x7fcce4001470 con 0x7fccec157a10 2022-03-21T13:55:01.491 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 >> v1:172.21.15.160:6789/0 conn(0x7fccec157a10 legacy=0x7fccec15f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.491 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 --2- 172.21.15.160:0/3605592690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcccc0038e0 0x7fcccc003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.492 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 --2- 172.21.15.160:0/3605592690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 0x7fcccc004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.492 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 --2- 172.21.15.160:0/3605592690 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcccc005040 0x7fcccc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.492 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec06baa0 con 0x7fcccc004690 2022-03-21T13:55:01.492 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc00bf50 con 0x7fcccc0038e0 2022-03-21T13:55:01.493 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc00c110 con 0x7fcccc005040 2022-03-21T13:55:01.493 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fccebfff700 1 --2- 172.21.15.160:0/3605592690 >> v2:172.21.15.171:3300/0 conn(0x7fccec158620 0x7fccec06ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:55:01.493 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fccf0c28700 1 --2- 172.21.15.160:0/3605592690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcccc0038e0 0x7fcccc003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.493 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fccebfff700 1 --2- 172.21.15.160:0/3605592690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 0x7fcccc004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.494 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fccf1429700 1 --2- 172.21.15.160:0/3605592690 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcccc005040 0x7fcccc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.494 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fccebfff700 1 -- 172.21.15.160:0/3605592690 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcccc005040 msgr2=0x7fcccc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.494 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fccebfff700 1 --2- 172.21.15.160:0/3605592690 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcccc005040 0x7fcccc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.494 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fccebfff700 1 -- 172.21.15.160:0/3605592690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcccc0038e0 msgr2=0x7fcccc003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.495 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fccebfff700 1 --2- 172.21.15.160:0/3605592690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcccc0038e0 0x7fcccc003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.495 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fccebfff700 1 -- 172.21.15.160:0/3605592690 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc0033f0 con 0x7fcccc004690 2022-03-21T13:55:01.495 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fccf1429700 1 -- 172.21.15.160:0/3605592690 reap_dead start 2022-03-21T13:55:01.495 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fccebfff700 1 --2- 172.21.15.160:0/3605592690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 0x7fcccc004b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fccec158a80 tx=0x7fccdc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156de54e6e1bcbd3 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.495 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc009c50 con 0x7fcccc004690 2022-03-21T13:55:01.496 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc00f040 con 0x7fcccc004690 2022-03-21T13:55:01.496 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.480+0000 7fcceb7fe700 1 -- 172.21.15.160:0/3605592690 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc00ee70 con 0x7fcccc004690 2022-03-21T13:55:01.496 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.481+0000 7fccf2e8c700 1 -- 172.21.15.160:0/3605592690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 msgr2=0x7fcccc004b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.496 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.481+0000 7fccf2e8c700 1 --2- 172.21.15.160:0/3605592690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 0x7fcccc004b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fccec158a80 tx=0x7fccdc00b040 comp rx=0 tx=0).stop 2022-03-21T13:55:01.497 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.481+0000 7fccf2e8c700 1 -- 172.21.15.160:0/3605592690 shutdown_connections 2022-03-21T13:55:01.497 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.481+0000 7fccf2e8c700 1 --2- 172.21.15.160:0/3605592690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 0x7fcccc004b00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.497 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.481+0000 7fccf2e8c700 1 -- 172.21.15.160:0/3605592690 >> 172.21.15.160:0/3605592690 conn(0x7fccec068620 msgr2=0x7fccec0cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.497 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.481+0000 7fccf2e8c700 1 -- 172.21.15.160:0/3605592690 shutdown_connections 2022-03-21T13:55:01.498 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.481+0000 7fccf2e8c700 1 -- 172.21.15.160:0/3605592690 wait complete. 2022-03-21T13:55:01.498 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.482+0000 7fccf2e8c700 1 Processor -- start 2022-03-21T13:55:01.498 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.482+0000 7fccf2e8c700 1 -- start start 2022-03-21T13:55:01.498 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf2e8c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 0x7fccec165100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.498 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf2e8c700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fccec0a9180 0x7fccec0c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf2e8c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccec153b70 0x7fccec153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf2e8c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec1536e0 con 0x7fcccc004690 2022-03-21T13:55:01.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf2e8c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec153100 con 0x7fccec153b70 2022-03-21T13:55:01.499 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf2e8c700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec154520 con 0x7fccec0a9180 2022-03-21T13:55:01.500 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf0c28700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 0x7fccec165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.500 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf0c28700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 0x7fccec165100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57106/0 (socket says 172.21.15.160:57106) 2022-03-21T13:55:01.500 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf0c28700 1 -- 172.21.15.160:0/2023507922 learned_addr learned my addr 172.21.15.160:0/2023507922 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.500 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccebfff700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fccec0a9180 0x7fccec0c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.501 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf1429700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccec153b70 0x7fccec153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.501 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf0c28700 1 -- 172.21.15.160:0/2023507922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fccec0a9180 msgr2=0x7fccec0c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.501 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf0c28700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fccec0a9180 0x7fccec0c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.501 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf0c28700 1 -- 172.21.15.160:0/2023507922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccec153b70 msgr2=0x7fccec153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.501 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf0c28700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccec153b70 0x7fccec153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.502 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf0c28700 1 -- 172.21.15.160:0/2023507922 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0a88f0 con 0x7fcccc004690 2022-03-21T13:55:01.502 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccebfff700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fccec0a9180 0x7fccec0c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:55:01.502 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf1429700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccec153b70 0x7fccec153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:55:01.502 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf0c28700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 0x7fccec165100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fccd400f6b0 tx=0x7fccd4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.503 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fcce8ff9700 1 -- 172.21.15.160:0/2023507922 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd40052e0 con 0x7fcccc004690 2022-03-21T13:55:01.503 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fcce8ff9700 1 -- 172.21.15.160:0/2023507922 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd40034c0 con 0x7fcccc004690 2022-03-21T13:55:01.503 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.483+0000 7fccf2e8c700 1 -- 172.21.15.160:0/2023507922 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec0a8bd0 con 0x7fcccc004690 2022-03-21T13:55:01.503 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.484+0000 7fcce8ff9700 1 -- 172.21.15.160:0/2023507922 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4003860 con 0x7fcccc004690 2022-03-21T13:55:01.504 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.484+0000 7fccf2e8c700 1 -- 172.21.15.160:0/2023507922 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec0a8eb0 con 0x7fcccc004690 2022-03-21T13:55:01.504 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.485+0000 7fcce8ff9700 1 -- 172.21.15.160:0/2023507922 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fccd4003c50 con 0x7fcccc004690 2022-03-21T13:55:01.504 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.485+0000 7fcce8ff9700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fccd0063d10 0x7fccd00661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.504 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.485+0000 7fccebfff700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fccd0063d10 0x7fccd00661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.504 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.485+0000 7fcce8ff9700 1 -- 172.21.15.160:0/2023507922 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fccd4080870 con 0x7fcccc004690 2022-03-21T13:55:01.505 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.486+0000 7fccebfff700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fccd0063d10 0x7fccd00661c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccec06c3c0 tx=0x7fccdc019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.505 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.487+0000 7fccfc7fdb80 1 Processor -- start 2022-03-21T13:55:01.505 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.487+0000 7fccfc7fdb80 1 -- start start 2022-03-21T13:55:01.520 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f84d10 0x55a799fbcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.520 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f85a00 0x55a799fbd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.521 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f850e0 0x55a799fcf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.521 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a799f05240 con 0x55a799f84d10 2022-03-21T13:55:01.521 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a799e55090 con 0x55a799f85a00 2022-03-21T13:55:01.521 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a799edabf0 con 0x55a799f850e0 2022-03-21T13:55:01.522 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccf0c28700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f84d10 0x55a799fbcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.522 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccf0c28700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f84d10 0x55a799fbcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57116/0 (socket says 172.21.15.160:57116) 2022-03-21T13:55:01.522 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccf0c28700 1 -- 172.21.15.160:0/465993109 learned_addr learned my addr 172.21.15.160:0/465993109 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.522 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccf0c28700 1 -- 172.21.15.160:0/465993109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f850e0 msgr2=0x55a799fcf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.523 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccf0c28700 1 --2- 172.21.15.160:0/465993109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f850e0 0x55a799fcf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.523 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccf0c28700 1 -- 172.21.15.160:0/465993109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f85a00 msgr2=0x55a799fbd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.523 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccf0c28700 1 --2- 172.21.15.160:0/465993109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f85a00 0x55a799fbd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.523 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccf0c28700 1 -- 172.21.15.160:0/465993109 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a799d6b360 con 0x55a799f84d10 2022-03-21T13:55:01.524 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fccf0c28700 1 --2- 172.21.15.160:0/465993109 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f84d10 0x55a799fbcb10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fccd4052d00 tx=0x7fccd4000f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3765135cbc5956b server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.524 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fcce1ffb700 1 -- 172.21.15.160:0/465993109 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd40596e0 con 0x55a799f84d10 2022-03-21T13:55:01.524 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fcce1ffb700 1 -- 172.21.15.160:0/465993109 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd40514b0 con 0x55a799f84d10 2022-03-21T13:55:01.525 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.488+0000 7fcce1ffb700 1 -- 172.21.15.160:0/465993109 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd401a310 con 0x55a799f84d10 2022-03-21T13:55:01.525 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.489+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/465993109 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f84d10 msgr2=0x55a799fbcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.525 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.489+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/465993109 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f84d10 0x55a799fbcb10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fccd4052d00 tx=0x7fccd4000f70 comp rx=0 tx=0).stop 2022-03-21T13:55:01.525 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.489+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/465993109 shutdown_connections 2022-03-21T13:55:01.526 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.489+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/465993109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f850e0 0x55a799fcf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.526 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.489+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/465993109 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f84d10 0x55a799fbcb10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.526 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.489+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/465993109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f85a00 0x55a799fbd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.526 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.489+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/465993109 >> 172.21.15.160:0/465993109 conn(0x55a799f84770 msgr2=0x55a799fca230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.526 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.489+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/465993109 shutdown_connections 2022-03-21T13:55:01.527 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.489+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/465993109 wait complete. 2022-03-21T13:55:01.527 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.490+0000 7fccfc7fdb80 1 -- start start 2022-03-21T13:55:01.527 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.490+0000 7fccfc7fdb80 1 Processor -- start 2022-03-21T13:55:01.527 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.490+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a799fc9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.528 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.490+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f850e0 0x55a799fd99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.528 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.490+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.528 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.490+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a799ed4cd0 con 0x55a799f85a00 2022-03-21T13:55:01.528 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.490+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a799d6d650 con 0x55a799f850e0 2022-03-21T13:55:01.528 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.490+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a799fbe060 con 0x55a799f84d10 2022-03-21T13:55:01.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccfc7fdb80 10 client.0 _ll_register_callbacks cb 0x55a799ce67b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-21T13:55:01.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccf1429700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccf1429700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57122/0 (socket says 172.21.15.160:57122) 2022-03-21T13:55:01.529 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccf1429700 1 -- 172.21.15.160:0/1097374711 learned_addr learned my addr 172.21.15.160:0/1097374711 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.530 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccf0c28700 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a799fc9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.530 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccebfff700 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f850e0 0x55a799fd99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.530 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccf1429700 1 -- 172.21.15.160:0/1097374711 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 msgr2=0x55a799fc9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.530 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccf1429700 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a799fc9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.531 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccf1429700 1 -- 172.21.15.160:0/1097374711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f850e0 msgr2=0x55a799fd99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.531 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccf1429700 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f850e0 0x55a799fd99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.531 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccf1429700 1 -- 172.21.15.160:0/1097374711 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec0a8eb0 con 0x55a799f85a00 2022-03-21T13:55:01.531 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccf1429700 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc00a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fccec069cc0 tx=0x7fcce4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15da54530a6d811 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.532 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccc2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2022-03-21T13:55:01.532 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccc2ffd700 1 -- 172.21.15.160:0/1097374711 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4019030 con 0x55a799f85a00 2022-03-21T13:55:01.532 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccc2ffd700 1 -- 172.21.15.160:0/1097374711 <== mon.0 v2:172.21.15.160:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcce401a070 con 0x55a799f85a00 2022-03-21T13:55:01.532 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1097374711 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a799f79a80 con 0x55a799f85a00 2022-03-21T13:55:01.532 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccc2ffd700 1 -- 172.21.15.160:0/1097374711 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcce4020470 con 0x55a799f85a00 2022-03-21T13:55:01.533 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccfc7fdb80 10 client.4674 fetch_fsmap learned FSMap version 17 2022-03-21T13:55:01.533 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1097374711 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a799d15fe0 con 0x55a799f85a00 2022-03-21T13:55:01.533 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.491+0000 7fccc2ffd700 1 -- 172.21.15.160:0/1097374711 <== mon.0 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a799f79a80 con 0x55a799f85a00 2022-03-21T13:55:01.533 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccc2ffd700 1 -- 172.21.15.160:0/1097374711 <== mon.0 v2:172.21.15.160:3300/0 5 ==== fsmap(e 17) v1 ==== 4238+0+0 (secure 0 0 0) 0x7fcce40205d0 con 0x55a799f85a00 2022-03-21T13:55:01.534 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccfc7fdb80 10 client.4674 fetch_fsmap finished waiting for FSMap version 17 2022-03-21T13:55:01.534 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccfc7fdb80 10 client.4674 resolve_mds: resolved name 'a' to daemon mds.a 2022-03-21T13:55:01.534 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccfc7fdb80 20 client.4674 populate_metadata read hostname 'smithi160' 2022-03-21T13:55:01.534 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.160:6836/3534006535,v1:172.21.15.160:6837/3534006535] conn(0x55a799fd6590 0x55a799fd6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.534 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccfc7fdb80 4 client.4674 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2022-03-21T13:55:01.535 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1097374711 --> [v2:172.21.15.160:6836/3534006535,v1:172.21.15.160:6837/3534006535] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a799f56600 con 0x55a799fd6590 2022-03-21T13:55:01.535 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccf0c28700 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.160:6836/3534006535,v1:172.21.15.160:6837/3534006535] conn(0x55a799fd6590 0x55a799fd6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.535 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccf0c28700 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.160:6836/3534006535,v1:172.21.15.160:6837/3534006535] conn(0x55a799fd6590 0x55a799fd6960 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2cbc431944c4f54 server_cookie=d596a7e155785743 in_seq=0 out_seq=0 2022-03-21T13:55:01.535 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccc2ffd700 10 client.4674 ms_handle_connect on v2:172.21.15.160:6836/3534006535 2022-03-21T13:55:01.536 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccc2ffd700 1 -- 172.21.15.160:0/1097374711 <== mds.3 v2:172.21.15.160:6836/3534006535 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x55a799f56600 con 0x55a799fd6590 2022-03-21T13:55:01.536 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccc2ffd700 10 client.4674 handle_command_reply: tid=0 2022-03-21T13:55:01.536 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.492+0000 7fccfc7fdb80 1 client.4674 shutdown 2022-03-21T13:55:01.536 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1097374711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 msgr2=0x55a799fc00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.536 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc00a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fccec069cc0 tx=0x7fcce4009040 comp rx=0 tx=0).stop 2022-03-21T13:55:01.537 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1097374711 shutdown_connections 2022-03-21T13:55:01.537 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.160:6836/3534006535,v1:172.21.15.160:6837/3534006535] conn(0x55a799fd6590 0x55a799fd6960 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.537 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc00a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.537 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccc2ffd700 0 client.4674 ms_handle_reset on v2:172.21.15.160:6836/3534006535 2022-03-21T13:55:01.538 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a799fc9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.538 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/1097374711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f850e0 0x55a799fd99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.538 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1097374711 >> 172.21.15.160:0/1097374711 conn(0x55a799f84770 msgr2=0x55a799fbb950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.538 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1097374711 shutdown_connections 2022-03-21T13:55:01.538 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1097374711 wait complete. 2022-03-21T13:55:01.539 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.493+0000 7fccfc7fdb80 20 client.4674 trim_cache size 0 max 16384 2022-03-21T13:55:01.539 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccfc7fdb80 1 Processor -- start 2022-03-21T13:55:01.539 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccfc7fdb80 1 -- start start 2022-03-21T13:55:01.539 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a799fd8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.540 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f850e0 0x55a799fd8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.540 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.540 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a799fb8cb0 con 0x55a799f85a00 2022-03-21T13:55:01.540 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a799f814c0 con 0x55a799f850e0 2022-03-21T13:55:01.541 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a799fbea30 con 0x55a799f84d10 2022-03-21T13:55:01.541 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccf1429700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.541 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccf1429700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57130/0 (socket says 172.21.15.160:57130) 2022-03-21T13:55:01.541 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccf1429700 1 -- 172.21.15.160:0/1636764640 learned_addr learned my addr 172.21.15.160:0/1636764640 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.541 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccf0c28700 1 --2- 172.21.15.160:0/1636764640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a799fd8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.542 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.510+0000 7fccebfff700 1 --2- 172.21.15.160:0/1636764640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f850e0 0x55a799fd8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.542 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccf1429700 1 -- 172.21.15.160:0/1636764640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 msgr2=0x55a799fd8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.542 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccf1429700 1 --2- 172.21.15.160:0/1636764640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a799fd8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.542 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccf1429700 1 -- 172.21.15.160:0/1636764640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f850e0 msgr2=0x55a799fd8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.543 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccf1429700 1 --2- 172.21.15.160:0/1636764640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f850e0 0x55a799fd8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.543 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccf1429700 1 -- 172.21.15.160:0/1636764640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a799d3df80 con 0x55a799f85a00 2022-03-21T13:55:01.543 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccf1429700 1 --2- 172.21.15.160:0/1636764640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc7c30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcce401df60 tx=0x7fcce4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27546b5d918fafa server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.543 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fcce27fc700 1 -- 172.21.15.160:0/1636764640 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4019040 con 0x55a799f85a00 2022-03-21T13:55:01.544 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fcce27fc700 1 -- 172.21.15.160:0/1636764640 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce4007160 con 0x55a799f85a00 2022-03-21T13:55:01.544 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fcce27fc700 1 -- 172.21.15.160:0/1636764640 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4001b10 con 0x55a799f85a00 2022-03-21T13:55:01.544 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1636764640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 msgr2=0x55a799fc7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.544 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/1636764640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc7c30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcce401df60 tx=0x7fcce4016000 comp rx=0 tx=0).stop 2022-03-21T13:55:01.544 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1636764640 shutdown_connections 2022-03-21T13:55:01.545 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/1636764640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f85a00 0x55a799fc7c30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.545 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/1636764640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a799fd8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.545 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/1636764640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f850e0 0x55a799fd8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.545 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1636764640 >> 172.21.15.160:0/1636764640 conn(0x55a799f84770 msgr2=0x55a799fc3010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.546 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1636764640 shutdown_connections 2022-03-21T13:55:01.546 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.511+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/1636764640 wait complete. 2022-03-21T13:55:01.546 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.512+0000 7fccfc7fdb80 1 -- start start 2022-03-21T13:55:01.546 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.512+0000 7fccfc7fdb80 1 Processor -- start 2022-03-21T13:55:01.546 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a79a02ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.547 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f850e0 0x55a79a025950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.547 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccfc7fdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f85a00 0x55a799fc4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.547 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a799fd07c0 con 0x55a799f850e0 2022-03-21T13:55:01.547 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a799fc6ad0 con 0x55a799f85a00 2022-03-21T13:55:01.548 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccfc7fdb80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a79a02f770 con 0x55a799f84d10 2022-03-21T13:55:01.548 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccfc7fdb80 10 client.0 _ll_register_callbacks cb 0x55a799ce67b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-21T13:55:01.548 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccebfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f850e0 0x55a79a025950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.548 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccebfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f850e0 0x55a79a025950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57136/0 (socket says 172.21.15.160:57136) 2022-03-21T13:55:01.549 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccebfff700 1 -- 172.21.15.160:0/3025873720 learned_addr learned my addr 172.21.15.160:0/3025873720 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.549 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccf0c28700 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a79a02ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.549 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccf1429700 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f85a00 0x55a799fc4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.549 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccebfff700 1 -- 172.21.15.160:0/3025873720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 msgr2=0x55a79a02ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.549 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccebfff700 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a79a02ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.550 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccebfff700 1 -- 172.21.15.160:0/3025873720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f85a00 msgr2=0x55a799fc4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.550 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccebfff700 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f85a00 0x55a799fc4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.550 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccebfff700 1 -- 172.21.15.160:0/3025873720 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a799d15fe0 con 0x55a799f850e0 2022-03-21T13:55:01.550 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccebfff700 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f850e0 0x55a79a025950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0099f0 tx=0x7fccdc022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ba8c08b1972ab9 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.551 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.513+0000 7fccc2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2022-03-21T13:55:01.551 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccc2ffd700 1 -- 172.21.15.160:0/3025873720 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc030070 con 0x55a799f850e0 2022-03-21T13:55:01.551 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccc2ffd700 1 -- 172.21.15.160:0/3025873720 <== mon.0 v2:172.21.15.160:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fccdc014690 con 0x55a799f850e0 2022-03-21T13:55:01.551 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/3025873720 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fccd40514b0 con 0x55a799f850e0 2022-03-21T13:55:01.551 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccc2ffd700 1 -- 172.21.15.160:0/3025873720 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccdc00e040 con 0x55a799f850e0 2022-03-21T13:55:01.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccfc7fdb80 10 client.4680 fetch_fsmap learned FSMap version 17 2022-03-21T13:55:01.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/3025873720 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a799d17b10 con 0x55a799f850e0 2022-03-21T13:55:01.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccc2ffd700 1 -- 172.21.15.160:0/3025873720 <== mon.0 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd40514b0 con 0x55a799f850e0 2022-03-21T13:55:01.552 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccc2ffd700 1 -- 172.21.15.160:0/3025873720 <== mon.0 v2:172.21.15.160:3300/0 5 ==== fsmap(e 17) v1 ==== 4238+0+0 (secure 0 0 0) 0x7fccdc014a60 con 0x55a799f850e0 2022-03-21T13:55:01.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccfc7fdb80 10 client.4680 fetch_fsmap finished waiting for FSMap version 17 2022-03-21T13:55:01.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccfc7fdb80 10 client.4680 resolve_mds: resolved name 'a' to daemon mds.a 2022-03-21T13:55:01.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccfc7fdb80 20 client.4680 populate_metadata read hostname 'smithi160' 2022-03-21T13:55:01.553 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.160:6836/3534006535,v1:172.21.15.160:6837/3534006535] conn(0x55a799fd2ab0 0x55a799fd2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.554 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccfc7fdb80 4 client.4680 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2022-03-21T13:55:01.554 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/3025873720 --> [v2:172.21.15.160:6836/3534006535,v1:172.21.15.160:6837/3534006535] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a799e925f0 con 0x55a799fd2ab0 2022-03-21T13:55:01.554 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccf0c28700 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.160:6836/3534006535,v1:172.21.15.160:6837/3534006535] conn(0x55a799fd2ab0 0x55a799fd2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.554 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccc2ffd700 10 client.4680 ms_handle_connect on v2:172.21.15.160:6836/3534006535 2022-03-21T13:55:01.554 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.514+0000 7fccf0c28700 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.160:6836/3534006535,v1:172.21.15.160:6837/3534006535] conn(0x55a799fd2ab0 0x55a799fd2e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c60c94492f8793bd server_cookie=5cac2c1e6459c1f9 in_seq=0 out_seq=0 2022-03-21T13:55:01.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccc2ffd700 1 -- 172.21.15.160:0/3025873720 <== mds.3 v2:172.21.15.160:6836/3534006535 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a799e925f0 con 0x55a799fd2ab0 2022-03-21T13:55:01.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccc2ffd700 10 client.4680 handle_command_reply: tid=0 2022-03-21T13:55:01.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 1 client.4680 shutdown 2022-03-21T13:55:01.555 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/3025873720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f850e0 msgr2=0x55a79a025950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.556 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f850e0 0x55a79a025950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0099f0 tx=0x7fccdc022040 comp rx=0 tx=0).stop 2022-03-21T13:55:01.556 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/3025873720 shutdown_connections 2022-03-21T13:55:01.556 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a799f85a00 0x55a799fc4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.556 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55a799f84d10 0x55a79a02ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.557 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.160:6836/3534006535,v1:172.21.15.160:6837/3534006535] conn(0x55a799fd2ab0 0x55a799fd2e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.557 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 1 --2- 172.21.15.160:0/3025873720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a799f850e0 0x55a79a025950 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.557 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccc2ffd700 0 client.4680 ms_handle_reset on v2:172.21.15.160:6836/3534006535 2022-03-21T13:55:01.557 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/3025873720 >> 172.21.15.160:0/3025873720 conn(0x55a799f84770 msgr2=0x55a799fc9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.557 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/3025873720 shutdown_connections 2022-03-21T13:55:01.558 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 1 -- 172.21.15.160:0/3025873720 wait complete. 2022-03-21T13:55:01.558 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccfc7fdb80 20 client.4680 trim_cache size 0 max 16384 2022-03-21T13:55:01.558 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2022-03-21T13:55:01.559 INFO:teuthology.orchestra.run.smithi160.stdout: "cluster_fsid": "b2a3ddc8-064e-4cc9-8187-33ea19afd50a", 2022-03-21T13:55:01.559 INFO:teuthology.orchestra.run.smithi160.stdout: "whoami": 3, 2022-03-21T13:55:01.559 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 4284, 2022-03-21T13:55:01.559 INFO:teuthology.orchestra.run.smithi160.stdout: "want_state": "up:active", 2022-03-21T13:55:01.560 INFO:teuthology.orchestra.run.smithi160.stdout: "state": "up:active", 2022-03-21T13:55:01.560 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs", 2022-03-21T13:55:01.560 INFO:teuthology.orchestra.run.smithi160.stdout: "rank_uptime": 17.237864432999999, 2022-03-21T13:55:01.560 INFO:teuthology.orchestra.run.smithi160.stdout: "mdsmap_epoch": 17, 2022-03-21T13:55:01.560 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_epoch": 20, 2022-03-21T13:55:01.561 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_epoch_barrier": 20, 2022-03-21T13:55:01.561 INFO:teuthology.orchestra.run.smithi160.stdout: "uptime": 38.893440454999997 2022-03-21T13:55:01.561 INFO:teuthology.orchestra.run.smithi160.stdout:} 2022-03-21T13:55:01.563 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccf2e8c700 1 -- 172.21.15.160:0/2023507922 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fccd0063d10 msgr2=0x7fccd00661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.563 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccf2e8c700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fccd0063d10 0x7fccd00661c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccec06c3c0 tx=0x7fccdc019000 comp rx=0 tx=0).stop 2022-03-21T13:55:01.563 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccf2e8c700 1 -- 172.21.15.160:0/2023507922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 msgr2=0x7fccec165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccf2e8c700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 0x7fccec165100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fccd400f6b0 tx=0x7fccd4009040 comp rx=0 tx=0).stop 2022-03-21T13:55:01.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccf2e8c700 1 -- 172.21.15.160:0/2023507922 shutdown_connections 2022-03-21T13:55:01.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccf2e8c700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7fccd0063d10 0x7fccd00661c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccf2e8c700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccec153b70 0x7fccec153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.564 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccf2e8c700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcccc004690 0x7fccec165100 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccf2e8c700 1 --2- 172.21.15.160:0/2023507922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fccec0a9180 0x7fccec0c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.515+0000 7fccf2e8c700 1 -- 172.21.15.160:0/2023507922 >> 172.21.15.160:0/2023507922 conn(0x7fccec068620 msgr2=0x7fccec0c4400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.516+0000 7fccf2e8c700 1 -- 172.21.15.160:0/2023507922 shutdown_connections 2022-03-21T13:55:01.565 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.516+0000 7fccf2e8c700 1 -- 172.21.15.160:0/2023507922 wait complete. 2022-03-21T13:55:01.566 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2022-03-21T13:55:01.679 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.679+0000 7f20ca93f700 1 Processor -- start 2022-03-21T13:55:01.680 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.679+0000 7f20ca93f700 1 -- start start 2022-03-21T13:55:01.685 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20ca93f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f20c414ca50 0x7f20c406cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.685 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20ca93f700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f20c406c1c0 0x7f20c406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.685 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20ca93f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c406d910 con 0x7f20c414ce20 2022-03-21T13:55:01.686 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20ca93f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c40c4f50 con 0x7f20c414ca50 2022-03-21T13:55:01.686 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20ca93f700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c406ded0 con 0x7f20c406c1c0 2022-03-21T13:55:01.686 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20c993d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f20c414ca50 0x7f20c406cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.686 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20ca13e700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f20c414ce20 0x7f20c40c0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:60298/0 (socket says 172.21.15.160:60298) 2022-03-21T13:55:01.687 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20ca13e700 1 -- 172.21.15.160:0/1840140272 learned_addr learned my addr 172.21.15.160:0/1840140272 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:55:01.687 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20c913c700 1 --2- 172.21.15.160:0/1840140272 >> v2:172.21.15.171:3300/0 conn(0x7f20c406c1c0 0x7f20c406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.687 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20c993d700 1 -- 172.21.15.160:0/1840140272 >> v2:172.21.15.171:3300/0 conn(0x7f20c406c1c0 msgr2=0x7f20c406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.687 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20c993d700 1 --2- 172.21.15.160:0/1840140272 >> v2:172.21.15.171:3300/0 conn(0x7f20c406c1c0 0x7f20c406d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.687 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20c993d700 1 -- 172.21.15.160:0/1840140272 >> v1:172.21.15.160:6789/0 conn(0x7f20c414ce20 legacy=0x7f20c40c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20c993d700 1 -- 172.21.15.160:0/1840140272 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c40c2b80 con 0x7f20c414ca50 2022-03-21T13:55:01.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20c893b700 1 -- 172.21.15.160:0/1840140272 <== mon.0 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358890945 0 0) 0x7f20c406d910 con 0x7f20c414ce20 2022-03-21T13:55:01.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20c993d700 1 --2- 172.21.15.160:0/1840140272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20c414ca50 0x7f20c406cbb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20c40c6430 tx=0x7f20bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a663cafb29c5a14 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.688 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20c893b700 1 -- 172.21.15.160:0/1840140272 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00e070 con 0x7f20c414ca50 2022-03-21T13:55:01.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20c893b700 1 -- 172.21.15.160:0/1840140272 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc00bc30 con 0x7f20c414ca50 2022-03-21T13:55:01.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.680+0000 7f20c893b700 1 -- 172.21.15.160:0/1840140272 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc012430 con 0x7f20c414ca50 2022-03-21T13:55:01.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.681+0000 7f20ca93f700 1 -- 172.21.15.160:0/1840140272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20c414ca50 msgr2=0x7f20c406cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.689 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.681+0000 7f20ca93f700 1 --2- 172.21.15.160:0/1840140272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20c414ca50 0x7f20c406cbb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20c40c6430 tx=0x7f20bc009780 comp rx=0 tx=0).stop 2022-03-21T13:55:01.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.681+0000 7f20ca93f700 1 -- 172.21.15.160:0/1840140272 shutdown_connections 2022-03-21T13:55:01.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.681+0000 7f20ca93f700 1 --2- 172.21.15.160:0/1840140272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20c414ca50 0x7f20c406cbb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.681+0000 7f20ca93f700 1 --2- 172.21.15.160:0/1840140272 >> v2:172.21.15.171:3300/0 conn(0x7f20c406c1c0 0x7f20c406d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.690 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.681+0000 7f20ca93f700 1 -- 172.21.15.160:0/1840140272 >> 172.21.15.160:0/1840140272 conn(0x7f20c40c9710 msgr2=0x7f20c40c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.681+0000 7f20ca93f700 1 -- 172.21.15.160:0/1840140272 shutdown_connections 2022-03-21T13:55:01.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.681+0000 7f20ca93f700 1 -- 172.21.15.160:0/1840140272 wait complete. 2022-03-21T13:55:01.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.682+0000 7f20ca93f700 1 Processor -- start 2022-03-21T13:55:01.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.682+0000 7f20ca93f700 1 -- start start 2022-03-21T13:55:01.691 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20ca93f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20c406c1c0 0x7f20c40c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20ca93f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20c414ca50 0x7f20c4162660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20ca93f700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20c414ce20 0x7f20c414bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20ca93f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40be250 con 0x7f20c406c1c0 2022-03-21T13:55:01.692 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20ca93f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40a48d0 con 0x7f20c414ca50 2022-03-21T13:55:01.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20ca93f700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40bff30 con 0x7f20c414ce20 2022-03-21T13:55:01.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20c993d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20c406c1c0 0x7f20c40c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20c993d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20c406c1c0 0x7f20c40c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57148/0 (socket says 172.21.15.160:57148) 2022-03-21T13:55:01.693 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20c993d700 1 -- 172.21.15.160:0/3430402057 learned_addr learned my addr 172.21.15.160:0/3430402057 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20c993d700 1 -- 172.21.15.160:0/3430402057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20c414ce20 msgr2=0x7f20c414bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20c993d700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20c414ce20 0x7f20c414bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20c993d700 1 -- 172.21.15.160:0/3430402057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20c414ca50 msgr2=0x7f20c4162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.694 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20c913c700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20c414ca50 0x7f20c4162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20c993d700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20c414ca50 0x7f20c4162660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20c993d700 1 -- 172.21.15.160:0/3430402057 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc009a20 con 0x7f20c406c1c0 2022-03-21T13:55:01.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20c993d700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20c406c1c0 0x7f20c40c58a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20bc013000 tx=0x7f20bc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.683+0000 7f20b1ffb700 1 -- 172.21.15.160:0/3430402057 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc003e70 con 0x7f20c406c1c0 2022-03-21T13:55:01.695 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.684+0000 7f20b1ffb700 1 -- 172.21.15.160:0/3430402057 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc012a20 con 0x7f20c406c1c0 2022-03-21T13:55:01.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.684+0000 7f20ca93f700 1 -- 172.21.15.160:0/3430402057 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c40bdc90 con 0x7f20c406c1c0 2022-03-21T13:55:01.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.684+0000 7f20b1ffb700 1 -- 172.21.15.160:0/3430402057 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc012de0 con 0x7f20c406c1c0 2022-03-21T13:55:01.696 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.684+0000 7f20ca93f700 1 -- 172.21.15.160:0/3430402057 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c4153bb0 con 0x7f20c406c1c0 2022-03-21T13:55:01.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.685+0000 7f20b1ffb700 1 -- 172.21.15.160:0/3430402057 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f20bc004250 con 0x7f20c406c1c0 2022-03-21T13:55:01.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.685+0000 7f20b1ffb700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f20a4063ce0 0x7f20a4066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.685+0000 7f20b1ffb700 1 -- 172.21.15.160:0/3430402057 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f20bc0832a0 con 0x7f20c406c1c0 2022-03-21T13:55:01.704 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.685+0000 7f20c913c700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f20a4063ce0 0x7f20a4066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.686+0000 7f20c913c700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f20a4063ce0 0x7f20a4066190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20b4006fd0 tx=0x7f20b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.687+0000 7f20d5512b80 1 Processor -- start 2022-03-21T13:55:01.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.687+0000 7f20d5512b80 1 -- start start 2022-03-21T13:55:01.705 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748bec0 0x55bcc74d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 0x55bcc74c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20d5512b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcc740c240 con 0x55bcc748c290 2022-03-21T13:55:01.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20d5512b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcc735c090 con 0x55bcc748bec0 2022-03-21T13:55:01.706 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20d5512b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bcc73e1bf0 con 0x55bcc748cad0 2022-03-21T13:55:01.707 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20c913c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.707 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20c913c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57158/0 (socket says 172.21.15.160:57158) 2022-03-21T13:55:01.707 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20c913c700 1 -- 172.21.15.160:0/4247913350 learned_addr learned my addr 172.21.15.160:0/4247913350 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.707 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20c913c700 1 -- 172.21.15.160:0/4247913350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 msgr2=0x55bcc74c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.708 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20c993d700 1 --2- 172.21.15.160:0/4247913350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748bec0 0x55bcc74d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.708 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20ca13e700 1 --2- 172.21.15.160:0/4247913350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 0x55bcc74c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.708 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20c913c700 1 --2- 172.21.15.160:0/4247913350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 0x55bcc74c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.708 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20c913c700 1 -- 172.21.15.160:0/4247913350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748bec0 msgr2=0x55bcc74d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.708 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20c913c700 1 --2- 172.21.15.160:0/4247913350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748bec0 0x55bcc74d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.709 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20c913c700 1 -- 172.21.15.160:0/4247913350 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcc7272360 con 0x55bcc748c290 2022-03-21T13:55:01.709 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.688+0000 7f20c913c700 1 --2- 172.21.15.160:0/4247913350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74c3d70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f20b40159e0 tx=0x7f20b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b48cdcbe48360a server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.709 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20aaffd700 1 -- 172.21.15.160:0/4247913350 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4015e50 con 0x55bcc748c290 2022-03-21T13:55:01.709 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20aaffd700 1 -- 172.21.15.160:0/4247913350 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b4013880 con 0x55bcc748c290 2022-03-21T13:55:01.710 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20aaffd700 1 -- 172.21.15.160:0/4247913350 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4013c40 con 0x55bcc748c290 2022-03-21T13:55:01.710 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20d5512b80 1 -- 172.21.15.160:0/4247913350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 msgr2=0x55bcc74c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.710 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20d5512b80 1 --2- 172.21.15.160:0/4247913350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74c3d70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f20b40159e0 tx=0x7f20b4015000 comp rx=0 tx=0).stop 2022-03-21T13:55:01.710 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20d5512b80 1 -- 172.21.15.160:0/4247913350 shutdown_connections 2022-03-21T13:55:01.711 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20d5512b80 1 --2- 172.21.15.160:0/4247913350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 0x55bcc74c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.711 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20d5512b80 1 --2- 172.21.15.160:0/4247913350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748bec0 0x55bcc74d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.711 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20d5512b80 1 --2- 172.21.15.160:0/4247913350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74c3d70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.711 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20d5512b80 1 -- 172.21.15.160:0/4247913350 >> 172.21.15.160:0/4247913350 conn(0x55bcc748b920 msgr2=0x55bcc74d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.711 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20d5512b80 1 -- 172.21.15.160:0/4247913350 shutdown_connections 2022-03-21T13:55:01.712 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.689+0000 7f20d5512b80 1 -- 172.21.15.160:0/4247913350 wait complete. 2022-03-21T13:55:01.712 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.690+0000 7f20d5512b80 1 -- start start 2022-03-21T13:55:01.712 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.690+0000 7f20d5512b80 1 Processor -- start 2022-03-21T13:55:01.712 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748bec0 0x55bcc748f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.712 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74d36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.713 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 0x55bcc74bf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.713 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20d5512b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcc73dbcd0 con 0x55bcc748c290 2022-03-21T13:55:01.713 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20d5512b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcc7274650 con 0x55bcc748bec0 2022-03-21T13:55:01.713 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20d5512b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bcc748f900 con 0x55bcc748cad0 2022-03-21T13:55:01.714 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20d5512b80 10 client.0 _ll_register_callbacks cb 0x55bcc71ed7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-21T13:55:01.714 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20c913c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74d36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.714 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20c913c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74d36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57164/0 (socket says 172.21.15.160:57164) 2022-03-21T13:55:01.714 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20c913c700 1 -- 172.21.15.160:0/2564300991 learned_addr learned my addr 172.21.15.160:0/2564300991 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.714 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20c993d700 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748bec0 0x55bcc748f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.715 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20ca13e700 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 0x55bcc74bf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.715 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20c913c700 1 -- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 msgr2=0x55bcc74bf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.715 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20c913c700 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 0x55bcc74bf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.715 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20c913c700 1 -- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748bec0 msgr2=0x55bcc748f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.716 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20c913c700 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748bec0 0x55bcc748f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.716 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20c913c700 1 -- 172.21.15.160:0/2564300991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b40155b0 con 0x55bcc748c290 2022-03-21T13:55:01.716 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20c913c700 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74d36c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009230 tx=0x7f20b4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fdaf85c0276e0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.716 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f209ffff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2022-03-21T13:55:01.716 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f209ffff700 1 -- 172.21.15.160:0/2564300991 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b40209a0 con 0x55bcc748c290 2022-03-21T13:55:01.717 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f209ffff700 1 -- 172.21.15.160:0/2564300991 <== mon.0 v2:172.21.15.160:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f20b4020b00 con 0x55bcc748c290 2022-03-21T13:55:01.717 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.691+0000 7f20d5512b80 1 -- 172.21.15.160:0/2564300991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bcc7480a80 con 0x55bcc748c290 2022-03-21T13:55:01.717 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f209ffff700 1 -- 172.21.15.160:0/2564300991 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20b402c450 con 0x55bcc748c290 2022-03-21T13:55:01.717 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f20d5512b80 10 client.4695 fetch_fsmap learned FSMap version 17 2022-03-21T13:55:01.718 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f20d5512b80 1 -- 172.21.15.160:0/2564300991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bcc721cfe0 con 0x55bcc748c290 2022-03-21T13:55:01.718 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f209ffff700 1 -- 172.21.15.160:0/2564300991 <== mon.0 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bcc7480a80 con 0x55bcc748c290 2022-03-21T13:55:01.718 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f209ffff700 1 -- 172.21.15.160:0/2564300991 <== mon.0 v2:172.21.15.160:3300/0 5 ==== fsmap(e 17) v1 ==== 4238+0+0 (secure 0 0 0) 0x7f20b402c5b0 con 0x55bcc748c290 2022-03-21T13:55:01.718 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f20d5512b80 10 client.4695 fetch_fsmap finished waiting for FSMap version 17 2022-03-21T13:55:01.718 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f20d5512b80 10 client.4695 resolve_mds: resolved name 'd' to daemon mds.d 2022-03-21T13:55:01.719 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f20d5512b80 20 client.4695 populate_metadata read hostname 'smithi160' 2022-03-21T13:55:01.719 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f20d5512b80 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:6834/826342148,v1:172.21.15.171:6835/826342148] conn(0x55bcc74e07b0 0x55bcc74e0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.719 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f20d5512b80 4 client.4695 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2022-03-21T13:55:01.719 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f20d5512b80 1 -- 172.21.15.160:0/2564300991 --> [v2:172.21.15.171:6834/826342148,v1:172.21.15.171:6835/826342148] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bcc745d600 con 0x55bcc74e07b0 2022-03-21T13:55:01.720 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f20c993d700 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:6834/826342148,v1:172.21.15.171:6835/826342148] conn(0x55bcc74e07b0 0x55bcc74e0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.720 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f209ffff700 10 client.4695 ms_handle_connect on v2:172.21.15.171:6834/826342148 2022-03-21T13:55:01.720 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.692+0000 7f20c993d700 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:6834/826342148,v1:172.21.15.171:6835/826342148] conn(0x55bcc74e07b0 0x55bcc74e0b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2701c3cc2db4a847 server_cookie=77b6e06cafb6698d in_seq=0 out_seq=0 2022-03-21T13:55:01.720 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f209ffff700 1 -- 172.21.15.160:0/2564300991 <== mds.2 v2:172.21.15.171:6834/826342148 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x55bcc745d600 con 0x55bcc74e07b0 2022-03-21T13:55:01.720 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f209ffff700 10 client.4695 handle_command_reply: tid=0 2022-03-21T13:55:01.721 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 1 client.4695 shutdown 2022-03-21T13:55:01.721 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 1 -- 172.21.15.160:0/2564300991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 msgr2=0x55bcc74d36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.721 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74d36c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009230 tx=0x7f20b4018000 comp rx=0 tx=0).stop 2022-03-21T13:55:01.721 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 1 -- 172.21.15.160:0/2564300991 shutdown_connections 2022-03-21T13:55:01.722 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:6834/826342148,v1:172.21.15.171:6835/826342148] conn(0x55bcc74e07b0 0x55bcc74e0b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.722 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 0x55bcc74bf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.722 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748bec0 0x55bcc748f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.722 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 1 --2- 172.21.15.160:0/2564300991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc74d36c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.722 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f209ffff700 0 client.4695 ms_handle_reset on v2:172.21.15.171:6834/826342148 2022-03-21T13:55:01.723 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 1 -- 172.21.15.160:0/2564300991 >> 172.21.15.160:0/2564300991 conn(0x55bcc748b920 msgr2=0x55bcc74885e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.723 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 1 -- 172.21.15.160:0/2564300991 shutdown_connections 2022-03-21T13:55:01.723 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 1 -- 172.21.15.160:0/2564300991 wait complete. 2022-03-21T13:55:01.723 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.693+0000 7f20d5512b80 20 client.4695 trim_cache size 0 max 16384 2022-03-21T13:55:01.730 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.710+0000 7f20d5512b80 1 Processor -- start 2022-03-21T13:55:01.730 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.710+0000 7f20d5512b80 1 -- start start 2022-03-21T13:55:01.731 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748bec0 0x55bcc74dd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.731 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748c290 0x55bcc74c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.731 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 0x55bcc74c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.731 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20d5512b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcc74d36a0 con 0x55bcc748bec0 2022-03-21T13:55:01.732 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20d5512b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcc74807f0 con 0x55bcc748c290 2022-03-21T13:55:01.732 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20d5512b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bcc74c0740 con 0x55bcc748cad0 2022-03-21T13:55:01.732 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20c993d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748bec0 0x55bcc74dd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.732 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20c993d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748bec0 0x55bcc74dd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57170/0 (socket says 172.21.15.160:57170) 2022-03-21T13:55:01.732 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20c993d700 1 -- 172.21.15.160:0/376922395 learned_addr learned my addr 172.21.15.160:0/376922395 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.733 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20c993d700 1 -- 172.21.15.160:0/376922395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 msgr2=0x55bcc74c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.733 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20c993d700 1 --2- 172.21.15.160:0/376922395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 0x55bcc74c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.733 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20c993d700 1 -- 172.21.15.160:0/376922395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748c290 msgr2=0x55bcc74c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.733 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20c993d700 1 --2- 172.21.15.160:0/376922395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748c290 0x55bcc74c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.733 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20c993d700 1 -- 172.21.15.160:0/376922395 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcc7244f80 con 0x55bcc748bec0 2022-03-21T13:55:01.734 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20c993d700 1 --2- 172.21.15.160:0/376922395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748bec0 0x55bcc74dd2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0097c0 tx=0x7f20bc083040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457603bb7807548c server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.734 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20ab7fe700 1 -- 172.21.15.160:0/376922395 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc081210 con 0x55bcc748bec0 2022-03-21T13:55:01.734 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20ab7fe700 1 -- 172.21.15.160:0/376922395 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc053b90 con 0x55bcc748bec0 2022-03-21T13:55:01.734 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.711+0000 7f20ab7fe700 1 -- 172.21.15.160:0/376922395 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc054f40 con 0x55bcc748bec0 2022-03-21T13:55:01.735 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.712+0000 7f20d5512b80 1 -- 172.21.15.160:0/376922395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748bec0 msgr2=0x55bcc74dd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.735 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.712+0000 7f20d5512b80 1 --2- 172.21.15.160:0/376922395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748bec0 0x55bcc74dd2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0097c0 tx=0x7f20bc083040 comp rx=0 tx=0).stop 2022-03-21T13:55:01.735 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.712+0000 7f20d5512b80 1 -- 172.21.15.160:0/376922395 shutdown_connections 2022-03-21T13:55:01.735 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.712+0000 7f20d5512b80 1 --2- 172.21.15.160:0/376922395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748cad0 0x55bcc74c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.735 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.712+0000 7f20d5512b80 1 --2- 172.21.15.160:0/376922395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748bec0 0x55bcc74dd2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.736 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.712+0000 7f20d5512b80 1 --2- 172.21.15.160:0/376922395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748c290 0x55bcc74c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.736 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.712+0000 7f20d5512b80 1 -- 172.21.15.160:0/376922395 >> 172.21.15.160:0/376922395 conn(0x55bcc748b920 msgr2=0x55bcc74cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.736 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.712+0000 7f20d5512b80 1 -- 172.21.15.160:0/376922395 shutdown_connections 2022-03-21T13:55:01.736 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.712+0000 7f20d5512b80 1 -- 172.21.15.160:0/376922395 wait complete. 2022-03-21T13:55:01.736 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.712+0000 7f20d5512b80 1 -- start start 2022-03-21T13:55:01.737 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.712+0000 7f20d5512b80 1 Processor -- start 2022-03-21T13:55:01.737 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.713+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748bec0 0x55bcc74879e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.737 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.713+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc752c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.737 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.713+0000 7f20d5512b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748cad0 0x55bcc74d4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.737 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.713+0000 7f20d5512b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcc74c13b0 con 0x55bcc748c290 2022-03-21T13:55:01.738 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.713+0000 7f20d5512b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcc74883f0 con 0x55bcc748cad0 2022-03-21T13:55:01.738 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.713+0000 7f20d5512b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bcc74cd780 con 0x55bcc748bec0 2022-03-21T13:55:01.738 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.713+0000 7f20d5512b80 10 client.0 _ll_register_callbacks cb 0x55bcc71ed7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-21T13:55:01.738 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.713+0000 7f20c913c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc752c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.738 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.713+0000 7f20c913c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc752c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57178/0 (socket says 172.21.15.160:57178) 2022-03-21T13:55:01.739 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.713+0000 7f20c913c700 1 -- 172.21.15.160:0/440852498 learned_addr learned my addr 172.21.15.160:0/440852498 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.739 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f20c993d700 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748bec0 0x55bcc74879e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.739 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f20c913c700 1 -- 172.21.15.160:0/440852498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748bec0 msgr2=0x55bcc74879e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.739 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f20c913c700 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748bec0 0x55bcc74879e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.740 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f20c913c700 1 -- 172.21.15.160:0/440852498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748cad0 msgr2=0x55bcc74d4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.740 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f20c913c700 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748cad0 0x55bcc74d4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.740 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f20c913c700 1 -- 172.21.15.160:0/440852498 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c4153bb0 con 0x55bcc748c290 2022-03-21T13:55:01.740 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f20c913c700 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc752c900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f20b4015820 tx=0x7f20b4029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dd150907ac09bb server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.740 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f209ffff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2022-03-21T13:55:01.741 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f209ffff700 1 -- 172.21.15.160:0/440852498 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b402c450 con 0x55bcc748c290 2022-03-21T13:55:01.741 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f209ffff700 1 -- 172.21.15.160:0/440852498 <== mon.0 v2:172.21.15.160:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f20b402c5b0 con 0x55bcc748c290 2022-03-21T13:55:01.741 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f20d5512b80 1 -- 172.21.15.160:0/440852498 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f20b4013880 con 0x55bcc748c290 2022-03-21T13:55:01.741 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f209ffff700 1 -- 172.21.15.160:0/440852498 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20b402a610 con 0x55bcc748c290 2022-03-21T13:55:01.741 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f20d5512b80 10 client.4701 fetch_fsmap learned FSMap version 17 2022-03-21T13:55:01.742 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f20d5512b80 1 -- 172.21.15.160:0/440852498 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bcc721eb10 con 0x55bcc748c290 2022-03-21T13:55:01.742 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f209ffff700 1 -- 172.21.15.160:0/440852498 <== mon.0 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b4013880 con 0x55bcc748c290 2022-03-21T13:55:01.742 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.714+0000 7f209ffff700 1 -- 172.21.15.160:0/440852498 <== mon.0 v2:172.21.15.160:3300/0 5 ==== fsmap(e 17) v1 ==== 4238+0+0 (secure 0 0 0) 0x7f20b402a770 con 0x55bcc748c290 2022-03-21T13:55:01.742 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 10 client.4701 fetch_fsmap finished waiting for FSMap version 17 2022-03-21T13:55:01.743 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 10 client.4701 resolve_mds: resolved name 'd' to daemon mds.d 2022-03-21T13:55:01.743 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 20 client.4701 populate_metadata read hostname 'smithi160' 2022-03-21T13:55:01.743 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.171:6834/826342148,v1:172.21.15.171:6835/826342148] conn(0x55bcc74d47a0 0x55bcc74cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.743 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 4 client.4701 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2022-03-21T13:55:01.743 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 1 -- 172.21.15.160:0/440852498 --> [v2:172.21.15.171:6834/826342148,v1:172.21.15.171:6835/826342148] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bcc73995f0 con 0x55bcc74d47a0 2022-03-21T13:55:01.744 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20c993d700 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.171:6834/826342148,v1:172.21.15.171:6835/826342148] conn(0x55bcc74d47a0 0x55bcc74cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.744 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f209ffff700 10 client.4701 ms_handle_connect on v2:172.21.15.171:6834/826342148 2022-03-21T13:55:01.744 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20c993d700 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.171:6834/826342148,v1:172.21.15.171:6835/826342148] conn(0x55bcc74d47a0 0x55bcc74cde80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c7f2cf0d0c4bcbc server_cookie=32f899f3f2a5141d in_seq=0 out_seq=0 2022-03-21T13:55:01.744 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f209ffff700 1 -- 172.21.15.160:0/440852498 <== mds.2 v2:172.21.15.171:6834/826342148 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55bcc73995f0 con 0x55bcc74d47a0 2022-03-21T13:55:01.744 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f209ffff700 10 client.4701 handle_command_reply: tid=0 2022-03-21T13:55:01.745 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 1 client.4701 shutdown 2022-03-21T13:55:01.745 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 1 -- 172.21.15.160:0/440852498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 msgr2=0x55bcc752c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.745 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc752c900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f20b4015820 tx=0x7f20b4029000 comp rx=0 tx=0).stop 2022-03-21T13:55:01.745 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 1 -- 172.21.15.160:0/440852498 shutdown_connections 2022-03-21T13:55:01.745 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.171:6834/826342148,v1:172.21.15.171:6835/826342148] conn(0x55bcc74d47a0 0x55bcc74cde80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.746 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.715+0000 7f20d5512b80 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcc748cad0 0x55bcc74d4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.746 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f209ffff700 0 client.4701 ms_handle_reset on v2:172.21.15.171:6834/826342148 2022-03-21T13:55:01.746 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20d5512b80 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55bcc748bec0 0x55bcc74879e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.746 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20d5512b80 1 --2- 172.21.15.160:0/440852498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bcc748c290 0x55bcc752c900 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.746 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20d5512b80 1 -- 172.21.15.160:0/440852498 >> 172.21.15.160:0/440852498 conn(0x55bcc748b920 msgr2=0x55bcc74dd200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.747 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20d5512b80 1 -- 172.21.15.160:0/440852498 shutdown_connections 2022-03-21T13:55:01.747 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20d5512b80 1 -- 172.21.15.160:0/440852498 wait complete. 2022-03-21T13:55:01.747 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20d5512b80 20 client.4701 trim_cache size 0 max 16384 2022-03-21T13:55:01.747 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2022-03-21T13:55:01.748 INFO:teuthology.orchestra.run.smithi160.stdout: "cluster_fsid": "b2a3ddc8-064e-4cc9-8187-33ea19afd50a", 2022-03-21T13:55:01.748 INFO:teuthology.orchestra.run.smithi160.stdout: "whoami": 2, 2022-03-21T13:55:01.748 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 4288, 2022-03-21T13:55:01.748 INFO:teuthology.orchestra.run.smithi160.stdout: "want_state": "up:active", 2022-03-21T13:55:01.749 INFO:teuthology.orchestra.run.smithi160.stdout: "state": "up:active", 2022-03-21T13:55:01.749 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs", 2022-03-21T13:55:01.749 INFO:teuthology.orchestra.run.smithi160.stdout: "rank_uptime": 23.452926081000001, 2022-03-21T13:55:01.749 INFO:teuthology.orchestra.run.smithi160.stdout: "mdsmap_epoch": 17, 2022-03-21T13:55:01.749 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_epoch": 20, 2022-03-21T13:55:01.750 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_epoch_barrier": 20, 2022-03-21T13:55:01.750 INFO:teuthology.orchestra.run.smithi160.stdout: "uptime": 39.082360841000003 2022-03-21T13:55:01.750 INFO:teuthology.orchestra.run.smithi160.stdout:} 2022-03-21T13:55:01.752 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 -- 172.21.15.160:0/3430402057 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f20a4063ce0 msgr2=0x7f20a4066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.752 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f20a4063ce0 0x7f20a4066190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20b4006fd0 tx=0x7f20b4008040 comp rx=0 tx=0).stop 2022-03-21T13:55:01.752 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 -- 172.21.15.160:0/3430402057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20c406c1c0 msgr2=0x7f20c40c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.752 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20c406c1c0 0x7f20c40c58a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20bc013000 tx=0x7f20bc019000 comp rx=0 tx=0).stop 2022-03-21T13:55:01.753 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 -- 172.21.15.160:0/3430402057 shutdown_connections 2022-03-21T13:55:01.753 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f20a4063ce0 0x7f20a4066190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.753 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20c414ce20 0x7f20c414bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.753 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20c406c1c0 0x7f20c40c58a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.753 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 --2- 172.21.15.160:0/3430402057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20c414ca50 0x7f20c4162660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.754 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 -- 172.21.15.160:0/3430402057 >> 172.21.15.160:0/3430402057 conn(0x7f20c40c9710 msgr2=0x7f20c4154a30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.754 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 -- 172.21.15.160:0/3430402057 shutdown_connections 2022-03-21T13:55:01.754 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.716+0000 7f20ca93f700 1 -- 172.21.15.160:0/3430402057 wait complete. 2022-03-21T13:55:01.755 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2022-03-21T13:55:01.869 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.868+0000 7f597b846700 1 Processor -- start 2022-03-21T13:55:01.869 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.869+0000 7f597b846700 1 -- start start 2022-03-21T13:55:01.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.869+0000 7f597b846700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5974157640 0x7f5974157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.869+0000 7f597b846700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5974157a10 0x7f5974158450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.869+0000 7f597b846700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5974158e30 con 0x7f59740cbca0 2022-03-21T13:55:01.872 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.869+0000 7f597b846700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597406baa0 con 0x7f5974157640 2022-03-21T13:55:01.873 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.869+0000 7f597b846700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59740c6d80 con 0x7f5974157a10 2022-03-21T13:55:01.873 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f59795e2700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5974157640 0x7f5974157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.873 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f5979de3700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f59740cbca0 0x7f597406ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:53428/0 (socket says 172.21.15.160:53428) 2022-03-21T13:55:01.873 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f5978de1700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5974157a10 0x7f5974158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f5979de3700 1 -- 172.21.15.160:0/1403864914 learned_addr learned my addr 172.21.15.160:0/1403864914 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:55:01.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f59795e2700 1 -- 172.21.15.160:0/1403864914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5974157a10 msgr2=0x7f5974158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f59795e2700 1 --2- 172.21.15.160:0/1403864914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5974157a10 0x7f5974158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f59795e2700 1 -- 172.21.15.160:0/1403864914 >> v1:172.21.15.171:6789/0 conn(0x7f59740cbca0 legacy=0x7f597406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.874 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f5973fff700 1 -- 172.21.15.160:0/1403864914 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052354555 0 0) 0x7f5974158e30 con 0x7f59740cbca0 2022-03-21T13:55:01.875 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f59795e2700 1 -- 172.21.15.160:0/1403864914 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974158b50 con 0x7f5974157640 2022-03-21T13:55:01.875 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f59795e2700 1 --2- 172.21.15.160:0/1403864914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5974157640 0x7f5974157f10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5964009e60 tx=0x7f5964009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8723bbe2d97b8d22 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.875 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f5973fff700 1 -- 172.21.15.160:0/1403864914 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596400e070 con 0x7f5974157640 2022-03-21T13:55:01.875 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f5973fff700 1 -- 172.21.15.160:0/1403864914 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596400bb60 con 0x7f5974157640 2022-03-21T13:55:01.875 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.870+0000 7f5973fff700 1 -- 172.21.15.160:0/1403864914 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964012430 con 0x7f5974157640 2022-03-21T13:55:01.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.871+0000 7f597b846700 1 -- 172.21.15.160:0/1403864914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5974157640 msgr2=0x7f5974157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.871+0000 7f597b846700 1 --2- 172.21.15.160:0/1403864914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5974157640 0x7f5974157f10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5964009e60 tx=0x7f5964009780 comp rx=0 tx=0).stop 2022-03-21T13:55:01.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.871+0000 7f597b846700 1 -- 172.21.15.160:0/1403864914 shutdown_connections 2022-03-21T13:55:01.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.871+0000 7f597b846700 1 --2- 172.21.15.160:0/1403864914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5974157640 0x7f5974157f10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.876 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.871+0000 7f597b846700 1 --2- 172.21.15.160:0/1403864914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5974157a10 0x7f5974158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.871+0000 7f597b846700 1 -- 172.21.15.160:0/1403864914 >> 172.21.15.160:0/1403864914 conn(0x7f5974068620 msgr2=0x7f59740cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.871+0000 7f597b846700 1 -- 172.21.15.160:0/1403864914 shutdown_connections 2022-03-21T13:55:01.877 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.871+0000 7f597b846700 1 -- 172.21.15.160:0/1403864914 wait complete. 2022-03-21T13:55:01.887 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.872+0000 7f597b846700 1 Processor -- start 2022-03-21T13:55:01.887 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.872+0000 7f597b846700 1 -- start start 2022-03-21T13:55:01.887 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f597b846700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cbca0 0x7f5974165610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.887 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f597b846700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5974157640 0x7f5974152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.888 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f597b846700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5974157a10 0x7f5974153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.888 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f597b846700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59741691b0 con 0x7f59740cbca0 2022-03-21T13:55:01.888 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f597b846700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974152190 con 0x7f5974157640 2022-03-21T13:55:01.888 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f597b846700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5974165180 con 0x7f5974157a10 2022-03-21T13:55:01.889 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f59795e2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cbca0 0x7f5974165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.889 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f59795e2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cbca0 0x7f5974165610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57190/0 (socket says 172.21.15.160:57190) 2022-03-21T13:55:01.889 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f59795e2700 1 -- 172.21.15.160:0/1896756347 learned_addr learned my addr 172.21.15.160:0/1896756347 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.889 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f5979de3700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5974157a10 0x7f5974153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f5978de1700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5974157640 0x7f5974152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f59795e2700 1 -- 172.21.15.160:0/1896756347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5974157a10 msgr2=0x7f5974153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f59795e2700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5974157a10 0x7f5974153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f59795e2700 1 -- 172.21.15.160:0/1896756347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5974157640 msgr2=0x7f5974152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.890 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f59795e2700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5974157640 0x7f5974152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.891 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.873+0000 7f59795e2700 1 -- 172.21.15.160:0/1896756347 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5964009a20 con 0x7f59740cbca0 2022-03-21T13:55:01.891 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.874+0000 7f59795e2700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cbca0 0x7f5974165610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5964003b90 tx=0x7f5964019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.891 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.874+0000 7f59717fa700 1 -- 172.21.15.160:0/1896756347 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596400be40 con 0x7f59740cbca0 2022-03-21T13:55:01.891 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.874+0000 7f59717fa700 1 -- 172.21.15.160:0/1896756347 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59640129b0 con 0x7f59740cbca0 2022-03-21T13:55:01.892 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.874+0000 7f59717fa700 1 -- 172.21.15.160:0/1896756347 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964012d70 con 0x7f59740cbca0 2022-03-21T13:55:01.892 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.874+0000 7f597b846700 1 -- 172.21.15.160:0/1896756347 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5974151bd0 con 0x7f59740cbca0 2022-03-21T13:55:01.892 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.874+0000 7f597b846700 1 -- 172.21.15.160:0/1896756347 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5974164e10 con 0x7f59740cbca0 2022-03-21T13:55:01.892 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.875+0000 7f59717fa700 1 -- 172.21.15.160:0/1896756347 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f5964004250 con 0x7f59740cbca0 2022-03-21T13:55:01.892 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.875+0000 7f59717fa700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f5954063d10 0x7f59540661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.893 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.876+0000 7f59717fa700 1 -- 172.21.15.160:0/1896756347 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f59640831f0 con 0x7f59740cbca0 2022-03-21T13:55:01.893 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.876+0000 7f5978de1700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f5954063d10 0x7f59540661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.893 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.876+0000 7f5978de1700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f5954063d10 0x7f59540661c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5974150180 tx=0x7f5968008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.893 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.877+0000 7f59851b7b80 1 Processor -- start 2022-03-21T13:55:01.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f59851b7b80 1 -- start start 2022-03-21T13:55:01.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512ddb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a6a00 0x5595512de050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a60e0 0x5595512f0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.894 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f59851b7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559551226240 con 0x5595512a5d10 2022-03-21T13:55:01.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f59851b7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559551176090 con 0x5595512a6a00 2022-03-21T13:55:01.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f59851b7b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595511fbbf0 con 0x5595512a60e0 2022-03-21T13:55:01.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f59795e2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512ddb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.895 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f59795e2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512ddb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57198/0 (socket says 172.21.15.160:57198) 2022-03-21T13:55:01.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f59795e2700 1 -- 172.21.15.160:0/3746688204 learned_addr learned my addr 172.21.15.160:0/3746688204 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f5979de3700 1 --2- 172.21.15.160:0/3746688204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a60e0 0x5595512f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.878+0000 7f5978de1700 1 --2- 172.21.15.160:0/3746688204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a6a00 0x5595512de050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59795e2700 1 -- 172.21.15.160:0/3746688204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a60e0 msgr2=0x5595512f0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.896 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59795e2700 1 --2- 172.21.15.160:0/3746688204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a60e0 0x5595512f0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59795e2700 1 -- 172.21.15.160:0/3746688204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a6a00 msgr2=0x5595512de050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59795e2700 1 --2- 172.21.15.160:0/3746688204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a6a00 0x5595512de050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59795e2700 1 -- 172.21.15.160:0/3746688204 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55955108c360 con 0x5595512a5d10 2022-03-21T13:55:01.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f5978de1700 1 --2- 172.21.15.160:0/3746688204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a6a00 0x5595512de050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:55:01.897 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59795e2700 1 --2- 172.21.15.160:0/3746688204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512ddb10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59640555e0 tx=0x7f59640098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f8292cd4ce59af server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.898 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f595a7fc700 1 -- 172.21.15.160:0/3746688204 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596405bf70 con 0x5595512a5d10 2022-03-21T13:55:01.898 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f595a7fc700 1 -- 172.21.15.160:0/3746688204 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596407be90 con 0x5595512a5d10 2022-03-21T13:55:01.898 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f595a7fc700 1 -- 172.21.15.160:0/3746688204 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59640520b0 con 0x5595512a5d10 2022-03-21T13:55:01.898 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59851b7b80 1 -- 172.21.15.160:0/3746688204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 msgr2=0x5595512ddb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59851b7b80 1 --2- 172.21.15.160:0/3746688204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512ddb10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59640555e0 tx=0x7f59640098a0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59851b7b80 1 -- 172.21.15.160:0/3746688204 shutdown_connections 2022-03-21T13:55:01.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59851b7b80 1 --2- 172.21.15.160:0/3746688204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a60e0 0x5595512f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59851b7b80 1 --2- 172.21.15.160:0/3746688204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512ddb10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.899 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59851b7b80 1 --2- 172.21.15.160:0/3746688204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a6a00 0x5595512de050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.900 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59851b7b80 1 -- 172.21.15.160:0/3746688204 >> 172.21.15.160:0/3746688204 conn(0x5595512a5770 msgr2=0x5595512eb230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.900 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59851b7b80 1 -- 172.21.15.160:0/3746688204 shutdown_connections 2022-03-21T13:55:01.900 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.879+0000 7f59851b7b80 1 -- 172.21.15.160:0/3746688204 wait complete. 2022-03-21T13:55:01.900 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.880+0000 7f59851b7b80 1 -- start start 2022-03-21T13:55:01.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.880+0000 7f59851b7b80 1 Processor -- start 2022-03-21T13:55:01.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a5d10 0x5595512e8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a60e0 0x5595512e3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x5595512f7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.901 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f59851b7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595511f5cd0 con 0x5595512a6a00 2022-03-21T13:55:01.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f59851b7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955108e650 con 0x5595512a5d10 2022-03-21T13:55:01.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f59851b7b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595512e75a0 con 0x5595512a60e0 2022-03-21T13:55:01.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f59851b7b80 10 client.0 _ll_register_callbacks cb 0x5595510077b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-21T13:55:01.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f5979de3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x5595512f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.902 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f5979de3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x5595512f7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57208/0 (socket says 172.21.15.160:57208) 2022-03-21T13:55:01.903 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f5979de3700 1 -- 172.21.15.160:0/555152717 learned_addr learned my addr 172.21.15.160:0/555152717 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.903 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f5979de3700 1 -- 172.21.15.160:0/555152717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a60e0 msgr2=0x5595512e3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.903 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f5978de1700 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a60e0 0x5595512e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.903 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f59795e2700 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a5d10 0x5595512e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.904 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f5979de3700 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a60e0 0x5595512e3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.904 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f5979de3700 1 -- 172.21.15.160:0/555152717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a5d10 msgr2=0x5595512e8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.904 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f5979de3700 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a5d10 0x5595512e8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.904 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f5979de3700 1 -- 172.21.15.160:0/555152717 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5974164e10 con 0x5595512a6a00 2022-03-21T13:55:01.904 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f5978de1700 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a60e0 0x5595512e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:55:01.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f59795e2700 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a5d10 0x5595512e8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:55:01.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f5979de3700 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x5595512f7860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f596c005b00 tx=0x7f596c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc23f81b8a5f3cbf server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.881+0000 7f594f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2022-03-21T13:55:01.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f594f7fe700 1 -- 172.21.15.160:0/555152717 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c001a80 con 0x5595512a6a00 2022-03-21T13:55:01.905 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f594f7fe700 1 -- 172.21.15.160:0/555152717 <== mon.0 v2:172.21.15.160:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f596c001be0 con 0x5595512a6a00 2022-03-21T13:55:01.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f59851b7b80 1 -- 172.21.15.160:0/555152717 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55955129aa80 con 0x5595512a6a00 2022-03-21T13:55:01.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f594f7fe700 1 -- 172.21.15.160:0/555152717 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f596c016e90 con 0x5595512a6a00 2022-03-21T13:55:01.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f59851b7b80 10 client.4710 fetch_fsmap learned FSMap version 17 2022-03-21T13:55:01.906 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f59851b7b80 1 -- 172.21.15.160:0/555152717 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559551036fe0 con 0x5595512a6a00 2022-03-21T13:55:01.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f594f7fe700 1 -- 172.21.15.160:0/555152717 <== mon.0 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55955129aa80 con 0x5595512a6a00 2022-03-21T13:55:01.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f594f7fe700 1 -- 172.21.15.160:0/555152717 <== mon.0 v2:172.21.15.160:3300/0 5 ==== fsmap(e 17) v1 ==== 4238+0+0 (secure 0 0 0) 0x7f596c016560 con 0x5595512a6a00 2022-03-21T13:55:01.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f59851b7b80 10 client.4710 fetch_fsmap finished waiting for FSMap version 17 2022-03-21T13:55:01.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f59851b7b80 10 client.4710 resolve_mds: resolved name 'e' to daemon mds.e 2022-03-21T13:55:01.907 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f59851b7b80 20 client.4710 populate_metadata read hostname 'smithi160' 2022-03-21T13:55:01.908 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f59851b7b80 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.160:6838/4108285334,v1:172.21.15.160:6839/4108285334] conn(0x5595512fa540 0x5595512fa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.908 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f59851b7b80 4 client.4710 mds_command: new command op to 4293 tid=0[{"prefix": "get_command_descriptions"}] 2022-03-21T13:55:01.908 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f59851b7b80 1 -- 172.21.15.160:0/555152717 --> [v2:172.21.15.160:6838/4108285334,v1:172.21.15.160:6839/4108285334] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559551277600 con 0x5595512fa540 2022-03-21T13:55:01.908 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f59795e2700 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.160:6838/4108285334,v1:172.21.15.160:6839/4108285334] conn(0x5595512fa540 0x5595512fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.909 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f594f7fe700 10 client.4710 ms_handle_connect on v2:172.21.15.160:6838/4108285334 2022-03-21T13:55:01.909 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.882+0000 7f59795e2700 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.160:6838/4108285334,v1:172.21.15.160:6839/4108285334] conn(0x5595512fa540 0x5595512fa910 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5480e28ee132079d server_cookie=487a422b0334725f in_seq=0 out_seq=0 2022-03-21T13:55:01.909 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f594f7fe700 1 -- 172.21.15.160:0/555152717 <== mds.1 v2:172.21.15.160:6838/4108285334 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x559551277600 con 0x5595512fa540 2022-03-21T13:55:01.909 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f594f7fe700 10 client.4710 handle_command_reply: tid=0 2022-03-21T13:55:01.909 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 1 client.4710 shutdown 2022-03-21T13:55:01.910 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 1 -- 172.21.15.160:0/555152717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 msgr2=0x5595512f7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.910 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x5595512f7860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f596c005b00 tx=0x7f596c009040 comp rx=0 tx=0).stop 2022-03-21T13:55:01.910 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 1 -- 172.21.15.160:0/555152717 shutdown_connections 2022-03-21T13:55:01.910 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x5595512f7860 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.910 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.160:6838/4108285334,v1:172.21.15.160:6839/4108285334] conn(0x5595512fa540 0x5595512fa910 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.911 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a5d10 0x5595512e8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.911 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 1 --2- 172.21.15.160:0/555152717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a60e0 0x5595512e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.911 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f594f7fe700 0 client.4710 ms_handle_reset on v2:172.21.15.160:6838/4108285334 2022-03-21T13:55:01.911 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 1 -- 172.21.15.160:0/555152717 >> 172.21.15.160:0/555152717 conn(0x5595512a5770 msgr2=0x5595512a9260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.912 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 1 -- 172.21.15.160:0/555152717 shutdown_connections 2022-03-21T13:55:01.912 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 1 -- 172.21.15.160:0/555152717 wait complete. 2022-03-21T13:55:01.912 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.883+0000 7f59851b7b80 20 client.4710 trim_cache size 0 max 16384 2022-03-21T13:55:01.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.900+0000 7f59851b7b80 1 Processor -- start 2022-03-21T13:55:01.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.900+0000 7f59851b7b80 1 -- start start 2022-03-21T13:55:01.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512e43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.920 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a60e0 0x5595512dd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.921 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a6a00 0x5595512dded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.921 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59851b7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595512e9ca0 con 0x5595512a5d10 2022-03-21T13:55:01.921 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59851b7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955129d2d0 con 0x5595512a60e0 2022-03-21T13:55:01.921 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59851b7b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595512e1480 con 0x5595512a6a00 2022-03-21T13:55:01.922 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59795e2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512e43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.922 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59795e2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512e43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57212/0 (socket says 172.21.15.160:57212) 2022-03-21T13:55:01.922 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59795e2700 1 -- 172.21.15.160:0/86285637 learned_addr learned my addr 172.21.15.160:0/86285637 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.922 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59795e2700 1 -- 172.21.15.160:0/86285637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a6a00 msgr2=0x5595512dded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.923 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f5979de3700 1 --2- 172.21.15.160:0/86285637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a6a00 0x5595512dded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.923 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f5978de1700 1 --2- 172.21.15.160:0/86285637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a60e0 0x5595512dd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.923 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59795e2700 1 --2- 172.21.15.160:0/86285637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a6a00 0x5595512dded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.923 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59795e2700 1 -- 172.21.15.160:0/86285637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a60e0 msgr2=0x5595512dd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59795e2700 1 --2- 172.21.15.160:0/86285637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a60e0 0x5595512dd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f59795e2700 1 -- 172.21.15.160:0/86285637 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55955105ef80 con 0x5595512a5d10 2022-03-21T13:55:01.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.901+0000 7f5978de1700 1 --2- 172.21.15.160:0/86285637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a60e0 0x5595512dd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-21T13:55:01.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f59795e2700 1 --2- 172.21.15.160:0/86285637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512e43e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f596400b6e0 tx=0x7f5964029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8387334db457cf5c server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.924 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f595affd700 1 -- 172.21.15.160:0/86285637 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964051ce0 con 0x5595512a5d10 2022-03-21T13:55:01.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f595affd700 1 -- 172.21.15.160:0/86285637 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596405bf70 con 0x5595512a5d10 2022-03-21T13:55:01.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f595affd700 1 -- 172.21.15.160:0/86285637 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964004040 con 0x5595512a5d10 2022-03-21T13:55:01.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f59851b7b80 1 -- 172.21.15.160:0/86285637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 msgr2=0x5595512e43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.925 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f59851b7b80 1 --2- 172.21.15.160:0/86285637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512e43e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f596400b6e0 tx=0x7f5964029000 comp rx=0 tx=0).stop 2022-03-21T13:55:01.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f59851b7b80 1 -- 172.21.15.160:0/86285637 shutdown_connections 2022-03-21T13:55:01.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f59851b7b80 1 --2- 172.21.15.160:0/86285637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a6a00 0x5595512dded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f59851b7b80 1 --2- 172.21.15.160:0/86285637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a5d10 0x5595512e43e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f59851b7b80 1 --2- 172.21.15.160:0/86285637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a60e0 0x5595512dd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.926 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f59851b7b80 1 -- 172.21.15.160:0/86285637 >> 172.21.15.160:0/86285637 conn(0x5595512a5770 msgr2=0x5595512fa910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f59851b7b80 1 -- 172.21.15.160:0/86285637 shutdown_connections 2022-03-21T13:55:01.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.902+0000 7f59851b7b80 1 -- 172.21.15.160:0/86285637 wait complete. 2022-03-21T13:55:01.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.903+0000 7f59851b7b80 1 -- start start 2022-03-21T13:55:01.927 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.903+0000 7f59851b7b80 1 Processor -- start 2022-03-21T13:55:01.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a5d10 0x5595512a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a60e0 0x5595512e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f59851b7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x559551346b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f59851b7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595512e73f0 con 0x5595512a6a00 2022-03-21T13:55:01.928 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f59851b7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955134fe60 con 0x5595512a60e0 2022-03-21T13:55:01.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f59851b7b80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595512e6a30 con 0x5595512a5d10 2022-03-21T13:55:01.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f59851b7b80 10 client.0 _ll_register_callbacks cb 0x5595510077b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-21T13:55:01.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f5979de3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x559551346b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.929 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f5979de3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x559551346b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57222/0 (socket says 172.21.15.160:57222) 2022-03-21T13:55:01.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f5979de3700 1 -- 172.21.15.160:0/550262257 learned_addr learned my addr 172.21.15.160:0/550262257 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:01.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f59795e2700 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a5d10 0x5595512a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f5978de1700 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a60e0 0x5595512e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f5979de3700 1 -- 172.21.15.160:0/550262257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a5d10 msgr2=0x5595512a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.930 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f5979de3700 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a5d10 0x5595512a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f5979de3700 1 -- 172.21.15.160:0/550262257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a60e0 msgr2=0x5595512e61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:01.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f5979de3700 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a60e0 0x5595512e61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f5979de3700 1 -- 172.21.15.160:0/550262257 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55955108c360 con 0x5595512a6a00 2022-03-21T13:55:01.931 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f5979de3700 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x559551346b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f596c0011e0 tx=0x7f596c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92f375150f7cf44 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:01.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f594f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2022-03-21T13:55:01.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f594f7fe700 1 -- 172.21.15.160:0/550262257 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c001a80 con 0x5595512a6a00 2022-03-21T13:55:01.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f594f7fe700 1 -- 172.21.15.160:0/550262257 <== mon.0 v2:172.21.15.160:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f596c001be0 con 0x5595512a6a00 2022-03-21T13:55:01.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f59851b7b80 1 -- 172.21.15.160:0/550262257 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f596407be90 con 0x5595512a6a00 2022-03-21T13:55:01.932 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f594f7fe700 1 -- 172.21.15.160:0/550262257 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f596c016240 con 0x5595512a6a00 2022-03-21T13:55:01.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f59851b7b80 10 client.4716 fetch_fsmap learned FSMap version 17 2022-03-21T13:55:01.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.904+0000 7f59851b7b80 1 -- 172.21.15.160:0/550262257 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559551038b10 con 0x5595512a6a00 2022-03-21T13:55:01.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f594f7fe700 1 -- 172.21.15.160:0/550262257 <== mon.0 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596407be90 con 0x5595512a6a00 2022-03-21T13:55:01.933 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f594f7fe700 1 -- 172.21.15.160:0/550262257 <== mon.0 v2:172.21.15.160:3300/0 5 ==== fsmap(e 17) v1 ==== 4238+0+0 (secure 0 0 0) 0x7f596c028070 con 0x5595512a6a00 2022-03-21T13:55:01.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 10 client.4716 fetch_fsmap finished waiting for FSMap version 17 2022-03-21T13:55:01.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 10 client.4716 resolve_mds: resolved name 'e' to daemon mds.e 2022-03-21T13:55:01.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 20 client.4716 populate_metadata read hostname 'smithi160' 2022-03-21T13:55:01.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.160:6838/4108285334,v1:172.21.15.160:6839/4108285334] conn(0x5595512f38a0 0x5595512f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:01.934 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 4 client.4716 mds_command: new command op to 4293 tid=0[{"prefix": "status"}] 2022-03-21T13:55:01.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 1 -- 172.21.15.160:0/550262257 --> [v2:172.21.15.160:6838/4108285334,v1:172.21.15.160:6839/4108285334] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5595511b35f0 con 0x5595512f38a0 2022-03-21T13:55:01.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59795e2700 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.160:6838/4108285334,v1:172.21.15.160:6839/4108285334] conn(0x5595512f38a0 0x5595512f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:01.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f594f7fe700 10 client.4716 ms_handle_connect on v2:172.21.15.160:6838/4108285334 2022-03-21T13:55:01.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59795e2700 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.160:6838/4108285334,v1:172.21.15.160:6839/4108285334] conn(0x5595512f38a0 0x5595512f3c70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b7b1f3f9a94c3de2 server_cookie=7907066d9453a88a in_seq=0 out_seq=0 2022-03-21T13:55:01.935 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f594f7fe700 1 -- 172.21.15.160:0/550262257 <== mds.1 v2:172.21.15.160:6838/4108285334 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5595511b35f0 con 0x5595512f38a0 2022-03-21T13:55:01.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f594f7fe700 10 client.4716 handle_command_reply: tid=0 2022-03-21T13:55:01.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 1 client.4716 shutdown 2022-03-21T13:55:01.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 1 -- 172.21.15.160:0/550262257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 msgr2=0x559551346b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.936 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x559551346b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f596c0011e0 tx=0x7f596c019000 comp rx=0 tx=0).stop 2022-03-21T13:55:01.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 1 -- 172.21.15.160:0/550262257 shutdown_connections 2022-03-21T13:55:01.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5595512a6a00 0x559551346b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5595512a5d10 0x5595512a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.160:6838/4108285334,v1:172.21.15.160:6839/4108285334] conn(0x5595512f38a0 0x5595512f3c70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.937 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 1 --2- 172.21.15.160:0/550262257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5595512a60e0 0x5595512e61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f594f7fe700 0 client.4716 ms_handle_reset on v2:172.21.15.160:6838/4108285334 2022-03-21T13:55:01.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.905+0000 7f59851b7b80 1 -- 172.21.15.160:0/550262257 >> 172.21.15.160:0/550262257 conn(0x5595512a5770 msgr2=0x5595512dd630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f59851b7b80 1 -- 172.21.15.160:0/550262257 shutdown_connections 2022-03-21T13:55:01.938 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f59851b7b80 1 -- 172.21.15.160:0/550262257 wait complete. 2022-03-21T13:55:01.939 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f59851b7b80 20 client.4716 trim_cache size 0 max 16384 2022-03-21T13:55:01.939 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2022-03-21T13:55:01.939 INFO:teuthology.orchestra.run.smithi160.stdout: "cluster_fsid": "b2a3ddc8-064e-4cc9-8187-33ea19afd50a", 2022-03-21T13:55:01.940 INFO:teuthology.orchestra.run.smithi160.stdout: "whoami": 1, 2022-03-21T13:55:01.940 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 4293, 2022-03-21T13:55:01.940 INFO:teuthology.orchestra.run.smithi160.stdout: "want_state": "up:active", 2022-03-21T13:55:01.940 INFO:teuthology.orchestra.run.smithi160.stdout: "state": "up:active", 2022-03-21T13:55:01.941 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs", 2022-03-21T13:55:01.941 INFO:teuthology.orchestra.run.smithi160.stdout: "rank_uptime": 28.695770618000001, 2022-03-21T13:55:01.941 INFO:teuthology.orchestra.run.smithi160.stdout: "mdsmap_epoch": 17, 2022-03-21T13:55:01.941 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_epoch": 20, 2022-03-21T13:55:01.941 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_epoch_barrier": 20, 2022-03-21T13:55:01.942 INFO:teuthology.orchestra.run.smithi160.stdout: "uptime": 39.279605656999998 2022-03-21T13:55:01.942 INFO:teuthology.orchestra.run.smithi160.stdout:} 2022-03-21T13:55:01.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 -- 172.21.15.160:0/1896756347 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f5954063d10 msgr2=0x7f59540661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f5954063d10 0x7f59540661c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5974150180 tx=0x7f5968008040 comp rx=0 tx=0).stop 2022-03-21T13:55:01.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 -- 172.21.15.160:0/1896756347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cbca0 msgr2=0x7f5974165610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:01.944 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cbca0 0x7f5974165610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5964003b90 tx=0x7f5964019000 comp rx=0 tx=0).stop 2022-03-21T13:55:01.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 -- 172.21.15.160:0/1896756347 shutdown_connections 2022-03-21T13:55:01.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f5954063d10 0x7f59540661c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5974157a10 0x7f5974153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cbca0 0x7f5974165610 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.945 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 --2- 172.21.15.160:0/1896756347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5974157640 0x7f5974152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:01.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 -- 172.21.15.160:0/1896756347 >> 172.21.15.160:0/1896756347 conn(0x7f5974068620 msgr2=0x7f59740c5600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:01.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 -- 172.21.15.160:0/1896756347 shutdown_connections 2022-03-21T13:55:01.946 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:01.906+0000 7f597b846700 1 -- 172.21.15.160:0/1896756347 wait complete. 2022-03-21T13:55:01.947 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2022-03-21T13:55:02.061 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.060+0000 7f4381809700 1 Processor -- start 2022-03-21T13:55:02.062 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.060+0000 7f4381809700 1 -- start start 2022-03-21T13:55:02.068 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.061+0000 7f4381809700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437c0c45d0 0x7f437c0c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.068 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.061+0000 7f4381809700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f437c06ac50 0x7f437c0c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.068 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.061+0000 7f4381809700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437c06b6d0 con 0x7f437c0c49a0 2022-03-21T13:55:02.069 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.061+0000 7f4381809700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437c0c7300 con 0x7f437c06ac50 2022-03-21T13:55:02.069 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.061+0000 7f4381809700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c06a6d0 con 0x7f437c0c45d0 2022-03-21T13:55:02.069 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.061+0000 7f437a7fc700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f437c06ac50 0x7f437c0c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.069 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.061+0000 7f437affd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437c0c45d0 0x7f437c0c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.070 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.061+0000 7f437b7fe700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f437c0c49a0 0x7f437c0c33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.160:53468/0 (socket says 172.21.15.160:53468) 2022-03-21T13:55:02.070 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.061+0000 7f437b7fe700 1 -- 172.21.15.160:0/3110723638 learned_addr learned my addr 172.21.15.160:0/3110723638 (peer_addr_for_me v1:172.21.15.160:0/0) 2022-03-21T13:55:02.070 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f437a7fc700 1 -- 172.21.15.160:0/3110723638 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437c0c45d0 msgr2=0x7f437c0c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:02.070 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f437a7fc700 1 --2- 172.21.15.160:0/3110723638 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437c0c45d0 0x7f437c0c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.071 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f437a7fc700 1 -- 172.21.15.160:0/3110723638 >> v1:172.21.15.171:6789/0 conn(0x7f437c0c49a0 legacy=0x7f437c0c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.071 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f4379ffb700 1 -- 172.21.15.160:0/3110723638 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158279200 0 0) 0x7f437c06b6d0 con 0x7f437c0c49a0 2022-03-21T13:55:02.071 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f437a7fc700 1 -- 172.21.15.160:0/3110723638 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c06b900 con 0x7f437c06ac50 2022-03-21T13:55:02.071 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f437affd700 1 --2- 172.21.15.160:0/3110723638 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437c0c45d0 0x7f437c0c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-21T13:55:02.072 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f437a7fc700 1 --2- 172.21.15.160:0/3110723638 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f437c06ac50 0x7f437c0c5df0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4364009760 tx=0x7f4364009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ba75bf8e271c177 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:02.072 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f4379ffb700 1 -- 172.21.15.160:0/3110723638 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364011630 con 0x7f437c06ac50 2022-03-21T13:55:02.072 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f4379ffb700 1 -- 172.21.15.160:0/3110723638 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4364011790 con 0x7f437c06ac50 2022-03-21T13:55:02.072 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f4379ffb700 1 -- 172.21.15.160:0/3110723638 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364011b50 con 0x7f437c06ac50 2022-03-21T13:55:02.073 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f4381809700 1 -- 172.21.15.160:0/3110723638 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f437c06ac50 msgr2=0x7f437c0c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.073 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f4381809700 1 --2- 172.21.15.160:0/3110723638 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f437c06ac50 0x7f437c0c5df0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4364009760 tx=0x7f4364009060 comp rx=0 tx=0).stop 2022-03-21T13:55:02.073 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f4381809700 1 -- 172.21.15.160:0/3110723638 shutdown_connections 2022-03-21T13:55:02.073 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f4381809700 1 --2- 172.21.15.160:0/3110723638 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437c0c45d0 0x7f437c0c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.073 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f4381809700 1 --2- 172.21.15.160:0/3110723638 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f437c06ac50 0x7f437c0c5df0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.074 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.062+0000 7f4381809700 1 -- 172.21.15.160:0/3110723638 >> 172.21.15.160:0/3110723638 conn(0x7f437c068650 msgr2=0x7f437c0cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:02.074 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.063+0000 7f4381809700 1 -- 172.21.15.160:0/3110723638 shutdown_connections 2022-03-21T13:55:02.074 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.063+0000 7f4381809700 1 -- 172.21.15.160:0/3110723638 wait complete. 2022-03-21T13:55:02.074 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.064+0000 7f4381809700 1 Processor -- start 2022-03-21T13:55:02.075 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.064+0000 7f4381809700 1 -- start start 2022-03-21T13:55:02.075 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.064+0000 7f4381809700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f437c0c45d0 0x7f437c155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.075 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.064+0000 7f4381809700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437c0c49a0 0x7f437c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.075 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.064+0000 7f4381809700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f437c1664e0 0x7f437c166910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.076 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.064+0000 7f4381809700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c166e50 con 0x7f437c1664e0 2022-03-21T13:55:02.076 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.064+0000 7f4381809700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c0c0160 con 0x7f437c0c45d0 2022-03-21T13:55:02.076 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.064+0000 7f4381809700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c0c0fc0 con 0x7f437c0c49a0 2022-03-21T13:55:02.076 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f437b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f437c1664e0 0x7f437c166910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.077 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f437affd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f437c0c45d0 0x7f437c155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.077 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f437b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f437c1664e0 0x7f437c166910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57236/0 (socket says 172.21.15.160:57236) 2022-03-21T13:55:02.077 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f437b7fe700 1 -- 172.21.15.160:0/1039124267 learned_addr learned my addr 172.21.15.160:0/1039124267 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:02.077 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f437a7fc700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437c0c49a0 0x7f437c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.078 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f437b7fe700 1 -- 172.21.15.160:0/1039124267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437c0c49a0 msgr2=0x7f437c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.078 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f437b7fe700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437c0c49a0 0x7f437c154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.078 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f437b7fe700 1 -- 172.21.15.160:0/1039124267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f437c0c45d0 msgr2=0x7f437c155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.078 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f437b7fe700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f437c0c45d0 0x7f437c155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.079 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f437b7fe700 1 -- 172.21.15.160:0/1039124267 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c009a20 con 0x7f437c1664e0 2022-03-21T13:55:02.079 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f437b7fe700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f437c1664e0 0x7f437c166910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f437400c4c0 tx=0x7f4374007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:02.079 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f4372ffd700 1 -- 172.21.15.160:0/1039124267 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374007150 con 0x7f437c1664e0 2022-03-21T13:55:02.079 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f4372ffd700 1 -- 172.21.15.160:0/1039124267 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43740072b0 con 0x7f437c1664e0 2022-03-21T13:55:02.079 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f4372ffd700 1 -- 172.21.15.160:0/1039124267 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43740046b0 con 0x7f437c1664e0 2022-03-21T13:55:02.080 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f4381809700 1 -- 172.21.15.160:0/1039124267 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43640092a0 con 0x7f437c1664e0 2022-03-21T13:55:02.080 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.065+0000 7f4381809700 1 -- 172.21.15.160:0/1039124267 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437c0c03b0 con 0x7f437c1664e0 2022-03-21T13:55:02.080 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.066+0000 7f4372ffd700 1 -- 172.21.15.160:0/1039124267 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f4374010030 con 0x7f437c1664e0 2022-03-21T13:55:02.080 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.067+0000 7f4372ffd700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4360063ce0 0x7f4360066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.081 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.067+0000 7f4372ffd700 1 -- 172.21.15.160:0/1039124267 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4374080170 con 0x7f437c1664e0 2022-03-21T13:55:02.081 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.067+0000 7f437affd700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4360063ce0 0x7f4360066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.081 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.067+0000 7f437affd700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4360063ce0 0x7f4360066190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f436c009fd0 tx=0x7f436c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:02.089 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.069+0000 7f438b17ab80 1 Processor -- start 2022-03-21T13:55:02.089 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.069+0000 7f438b17ab80 1 -- start start 2022-03-21T13:55:02.090 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.069+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.090 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.069+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395ea00 0x5606b3996050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.090 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.069+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395e0e0 0x5606b39a8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.090 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.069+0000 7f438b17ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b38de240 con 0x5606b395dd10 2022-03-21T13:55:02.091 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f438b17ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b382e090 con 0x5606b395e0e0 2022-03-21T13:55:02.091 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f438b17ab80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606b38b3bf0 con 0x5606b395ea00 2022-03-21T13:55:02.091 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f437affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.091 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f437affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57240/0 (socket says 172.21.15.160:57240) 2022-03-21T13:55:02.092 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f437affd700 1 -- 172.21.15.160:0/2181522244 learned_addr learned my addr 172.21.15.160:0/2181522244 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:02.092 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f437a7fc700 1 --2- 172.21.15.160:0/2181522244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395ea00 0x5606b3996050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.092 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f437b7fe700 1 --2- 172.21.15.160:0/2181522244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395e0e0 0x5606b39a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.092 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f437affd700 1 -- 172.21.15.160:0/2181522244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395ea00 msgr2=0x5606b3996050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:02.093 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f437affd700 1 --2- 172.21.15.160:0/2181522244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395ea00 0x5606b3996050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.093 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f437affd700 1 -- 172.21.15.160:0/2181522244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395e0e0 msgr2=0x5606b39a8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:02.093 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f437affd700 1 --2- 172.21.15.160:0/2181522244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395e0e0 0x5606b39a8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.093 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f437affd700 1 -- 172.21.15.160:0/2181522244 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606b3744360 con 0x5606b395dd10 2022-03-21T13:55:02.094 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f437affd700 1 --2- 172.21.15.160:0/2181522244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f436c015930 tx=0x7f436c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738989e8c758260 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:02.094 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f435bfff700 1 -- 172.21.15.160:0/2181522244 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c00e040 con 0x5606b395dd10 2022-03-21T13:55:02.094 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f435bfff700 1 -- 172.21.15.160:0/2181522244 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c01b070 con 0x5606b395dd10 2022-03-21T13:55:02.094 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.070+0000 7f435bfff700 1 -- 172.21.15.160:0/2181522244 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c017ae0 con 0x5606b395dd10 2022-03-21T13:55:02.094 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.071+0000 7f438b17ab80 1 -- 172.21.15.160:0/2181522244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 msgr2=0x5606b3995b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.095 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.071+0000 7f438b17ab80 1 --2- 172.21.15.160:0/2181522244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f436c015930 tx=0x7f436c016000 comp rx=0 tx=0).stop 2022-03-21T13:55:02.095 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.071+0000 7f438b17ab80 1 -- 172.21.15.160:0/2181522244 shutdown_connections 2022-03-21T13:55:02.095 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.071+0000 7f438b17ab80 1 --2- 172.21.15.160:0/2181522244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395e0e0 0x5606b39a8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.095 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.071+0000 7f438b17ab80 1 --2- 172.21.15.160:0/2181522244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995b10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.096 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.071+0000 7f438b17ab80 1 --2- 172.21.15.160:0/2181522244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395ea00 0x5606b3996050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.096 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.071+0000 7f438b17ab80 1 -- 172.21.15.160:0/2181522244 >> 172.21.15.160:0/2181522244 conn(0x5606b395d770 msgr2=0x5606b39a3230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:02.096 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.071+0000 7f438b17ab80 1 -- 172.21.15.160:0/2181522244 shutdown_connections 2022-03-21T13:55:02.096 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.071+0000 7f438b17ab80 1 -- 172.21.15.160:0/2181522244 wait complete. 2022-03-21T13:55:02.097 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.072+0000 7f438b17ab80 1 -- start start 2022-03-21T13:55:02.097 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.072+0000 7f438b17ab80 1 Processor -- start 2022-03-21T13:55:02.097 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.072+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395dd10 0x5606b39b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.097 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.072+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39913b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.097 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.072+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b39918f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.098 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.072+0000 7f438b17ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b38adcd0 con 0x5606b395e0e0 2022-03-21T13:55:02.098 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f438b17ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b3746650 con 0x5606b395ea00 2022-03-21T13:55:02.098 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f438b17ab80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606b39b3310 con 0x5606b395dd10 2022-03-21T13:55:02.098 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f438b17ab80 10 client.0 _ll_register_callbacks cb 0x5606b36bf7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-21T13:55:02.099 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f437a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39913b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.099 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f437a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39913b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57248/0 (socket says 172.21.15.160:57248) 2022-03-21T13:55:02.099 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f437a7fc700 1 -- 172.21.15.160:0/1640708951 learned_addr learned my addr 172.21.15.160:0/1640708951 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:02.099 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f437affd700 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395dd10 0x5606b39b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.100 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f437b7fe700 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b39918f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.100 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f437a7fc700 1 -- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395dd10 msgr2=0x5606b39b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:02.100 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f437a7fc700 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395dd10 0x5606b39b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.100 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f437a7fc700 1 -- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 msgr2=0x5606b39918f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:02.100 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f437a7fc700 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b39918f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.101 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f437a7fc700 1 -- 172.21.15.160:0/1640708951 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c0155e0 con 0x5606b395e0e0 2022-03-21T13:55:02.101 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f437a7fc700 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39913b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4364009e00 tx=0x7f4364017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e257a580470a114e server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:02.101 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f43597fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2022-03-21T13:55:02.101 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f43597fa700 1 -- 172.21.15.160:0/1640708951 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364000d10 con 0x5606b395e0e0 2022-03-21T13:55:02.102 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f43597fa700 1 -- 172.21.15.160:0/1640708951 <== mon.0 v2:172.21.15.160:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4364004250 con 0x5606b395e0e0 2022-03-21T13:55:02.102 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f438b17ab80 1 -- 172.21.15.160:0/1640708951 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606b3952a80 con 0x5606b395e0e0 2022-03-21T13:55:02.102 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f43597fa700 1 -- 172.21.15.160:0/1640708951 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43640034e0 con 0x5606b395e0e0 2022-03-21T13:55:02.102 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f438b17ab80 10 client.4725 fetch_fsmap learned FSMap version 17 2022-03-21T13:55:02.103 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f438b17ab80 1 -- 172.21.15.160:0/1640708951 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5606b36eefe0 con 0x5606b395e0e0 2022-03-21T13:55:02.103 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f43597fa700 1 -- 172.21.15.160:0/1640708951 <== mon.0 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5606b3952a80 con 0x5606b395e0e0 2022-03-21T13:55:02.103 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f43597fa700 1 -- 172.21.15.160:0/1640708951 <== mon.0 v2:172.21.15.160:3300/0 5 ==== fsmap(e 17) v1 ==== 4238+0+0 (secure 0 0 0) 0x7f4364003640 con 0x5606b395e0e0 2022-03-21T13:55:02.103 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.073+0000 7f438b17ab80 10 client.4725 fetch_fsmap finished waiting for FSMap version 17 2022-03-21T13:55:02.103 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.074+0000 7f438b17ab80 10 client.4725 resolve_mds: resolved name 'f' to daemon mds.f 2022-03-21T13:55:02.104 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.074+0000 7f438b17ab80 20 client.4725 populate_metadata read hostname 'smithi160' 2022-03-21T13:55:02.104 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.074+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:6836/4225939003,v1:172.21.15.171:6837/4225939003] conn(0x5606b39af460 0x5606b39af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.104 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.074+0000 7f438b17ab80 4 client.4725 mds_command: new command op to 4294 tid=0[{"prefix": "get_command_descriptions"}] 2022-03-21T13:55:02.104 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.074+0000 7f438b17ab80 1 -- 172.21.15.160:0/1640708951 --> [v2:172.21.15.171:6836/4225939003,v1:172.21.15.171:6837/4225939003] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606b392f600 con 0x5606b39af460 2022-03-21T13:55:02.105 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.074+0000 7f437affd700 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:6836/4225939003,v1:172.21.15.171:6837/4225939003] conn(0x5606b39af460 0x5606b39af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.105 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.074+0000 7f43597fa700 10 client.4725 ms_handle_connect on v2:172.21.15.171:6836/4225939003 2022-03-21T13:55:02.105 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.074+0000 7f437affd700 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:6836/4225939003,v1:172.21.15.171:6837/4225939003] conn(0x5606b39af460 0x5606b39af830 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f7d669725c044c8 server_cookie=bacf41908e78b214 in_seq=0 out_seq=0 2022-03-21T13:55:02.105 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f43597fa700 1 -- 172.21.15.160:0/1640708951 <== mds.0 v2:172.21.15.171:6836/4225939003 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x5606b392f600 con 0x5606b39af460 2022-03-21T13:55:02.105 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f43597fa700 10 client.4725 handle_command_reply: tid=0 2022-03-21T13:55:02.106 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 1 client.4725 shutdown 2022-03-21T13:55:02.106 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 1 -- 172.21.15.160:0/1640708951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 msgr2=0x5606b39913b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.106 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39913b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4364009e00 tx=0x7f4364017000 comp rx=0 tx=0).stop 2022-03-21T13:55:02.106 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 1 -- 172.21.15.160:0/1640708951 shutdown_connections 2022-03-21T13:55:02.107 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:6836/4225939003,v1:172.21.15.171:6837/4225939003] conn(0x5606b39af460 0x5606b39af830 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.107 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b39918f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.107 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395dd10 0x5606b39b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.107 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1640708951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39913b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.108 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f43597fa700 0 client.4725 ms_handle_reset on v2:172.21.15.171:6836/4225939003 2022-03-21T13:55:02.108 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 1 -- 172.21.15.160:0/1640708951 >> 172.21.15.160:0/1640708951 conn(0x5606b395d770 msgr2=0x5606b3994950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:02.108 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 1 -- 172.21.15.160:0/1640708951 shutdown_connections 2022-03-21T13:55:02.108 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 1 -- 172.21.15.160:0/1640708951 wait complete. 2022-03-21T13:55:02.108 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.075+0000 7f438b17ab80 20 client.4725 trim_cache size 0 max 16384 2022-03-21T13:55:02.117 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.092+0000 7f438b17ab80 1 Processor -- start 2022-03-21T13:55:02.117 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.092+0000 7f438b17ab80 1 -- start start 2022-03-21T13:55:02.117 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.118 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395e0e0 0x5606b3959e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.118 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b395a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.118 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f438b17ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b39a23a0 con 0x5606b395dd10 2022-03-21T13:55:02.118 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f438b17ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b39a9610 con 0x5606b395ea00 2022-03-21T13:55:02.118 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f438b17ab80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606b399dd80 con 0x5606b395e0e0 2022-03-21T13:55:02.119 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f437affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.119 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f437affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57254/0 (socket says 172.21.15.160:57254) 2022-03-21T13:55:02.119 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f437affd700 1 -- 172.21.15.160:0/2083393016 learned_addr learned my addr 172.21.15.160:0/2083393016 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:02.119 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f437a7fc700 1 --2- 172.21.15.160:0/2083393016 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395e0e0 0x5606b3959e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.120 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f437affd700 1 -- 172.21.15.160:0/2083393016 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395e0e0 msgr2=0x5606b3959e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:02.120 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f437b7fe700 1 --2- 172.21.15.160:0/2083393016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b395a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.120 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f437affd700 1 --2- 172.21.15.160:0/2083393016 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395e0e0 0x5606b3959e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.120 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f437affd700 1 -- 172.21.15.160:0/2083393016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 msgr2=0x5606b395a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:02.121 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f437affd700 1 --2- 172.21.15.160:0/2083393016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b395a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.121 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f437affd700 1 -- 172.21.15.160:0/2083393016 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606b39a3ff0 con 0x5606b395dd10 2022-03-21T13:55:02.121 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f437affd700 1 --2- 172.21.15.160:0/2083393016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f436c023000 tx=0x7f436c033370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a2b0bcb978d5e9 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:02.121 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f4370ff9700 1 -- 172.21.15.160:0/2083393016 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c00e040 con 0x5606b395dd10 2022-03-21T13:55:02.122 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f4370ff9700 1 -- 172.21.15.160:0/2083393016 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c00f040 con 0x5606b395dd10 2022-03-21T13:55:02.122 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.093+0000 7f4370ff9700 1 -- 172.21.15.160:0/2083393016 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c017d60 con 0x5606b395dd10 2022-03-21T13:55:02.122 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.094+0000 7f438b17ab80 1 -- 172.21.15.160:0/2083393016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 msgr2=0x5606b3995990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.122 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.094+0000 7f438b17ab80 1 --2- 172.21.15.160:0/2083393016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f436c023000 tx=0x7f436c033370 comp rx=0 tx=0).stop 2022-03-21T13:55:02.123 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.094+0000 7f438b17ab80 1 -- 172.21.15.160:0/2083393016 shutdown_connections 2022-03-21T13:55:02.123 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.094+0000 7f438b17ab80 1 --2- 172.21.15.160:0/2083393016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b395a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.123 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.094+0000 7f438b17ab80 1 --2- 172.21.15.160:0/2083393016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395dd10 0x5606b3995990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.123 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.094+0000 7f438b17ab80 1 --2- 172.21.15.160:0/2083393016 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395e0e0 0x5606b3959e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.123 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.094+0000 7f438b17ab80 1 -- 172.21.15.160:0/2083393016 >> 172.21.15.160:0/2083393016 conn(0x5606b395d770 msgr2=0x5606b3994740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:02.124 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.094+0000 7f438b17ab80 1 -- 172.21.15.160:0/2083393016 shutdown_connections 2022-03-21T13:55:02.124 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.094+0000 7f438b17ab80 1 -- 172.21.15.160:0/2083393016 wait complete. 2022-03-21T13:55:02.124 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.094+0000 7f438b17ab80 1 -- start start 2022-03-21T13:55:02.124 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.094+0000 7f438b17ab80 1 Processor -- start 2022-03-21T13:55:02.125 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395dd10 0x5606b395f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.125 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39feb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.125 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f438b17ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b39589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.125 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f438b17ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b39ab8a0 con 0x5606b395e0e0 2022-03-21T13:55:02.125 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f438b17ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b3a089f0 con 0x5606b395ea00 2022-03-21T13:55:02.126 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f438b17ab80 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606b3a08cd0 con 0x5606b395dd10 2022-03-21T13:55:02.126 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f438b17ab80 10 client.0 _ll_register_callbacks cb 0x5606b36bf7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-21T13:55:02.126 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f437a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39feb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.126 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f437a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39feb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57262/0 (socket says 172.21.15.160:57262) 2022-03-21T13:55:02.127 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f437a7fc700 1 -- 172.21.15.160:0/1818373296 learned_addr learned my addr 172.21.15.160:0/1818373296 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:02.127 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f437b7fe700 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b39589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.127 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f437affd700 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395dd10 0x5606b395f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.127 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f437a7fc700 1 -- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395dd10 msgr2=0x5606b395f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:02.128 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f437a7fc700 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395dd10 0x5606b395f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.128 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f437a7fc700 1 -- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 msgr2=0x5606b39589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:02.128 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f437a7fc700 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b39589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.128 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f437a7fc700 1 -- 172.21.15.160:0/1818373296 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606b3744360 con 0x5606b395e0e0 2022-03-21T13:55:02.128 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.095+0000 7f437b7fe700 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b39589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:55:02.129 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f437a7fc700 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39feb10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4364006c40 tx=0x7f4364023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8862ed1e0e8f50 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:02.129 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f43597fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2022-03-21T13:55:02.129 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f43597fa700 1 -- 172.21.15.160:0/1818373296 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364011900 con 0x5606b395e0e0 2022-03-21T13:55:02.129 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f43597fa700 1 -- 172.21.15.160:0/1818373296 <== mon.0 v2:172.21.15.160:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4364011a60 con 0x5606b395e0e0 2022-03-21T13:55:02.130 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f438b17ab80 1 -- 172.21.15.160:0/1818373296 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f436c01b070 con 0x5606b395e0e0 2022-03-21T13:55:02.130 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f43597fa700 1 -- 172.21.15.160:0/1818373296 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43640036f0 con 0x5606b395e0e0 2022-03-21T13:55:02.130 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f438b17ab80 10 client.4731 fetch_fsmap learned FSMap version 17 2022-03-21T13:55:02.130 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f438b17ab80 1 -- 172.21.15.160:0/1818373296 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5606b3716f80 con 0x5606b395e0e0 2022-03-21T13:55:02.131 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f43597fa700 1 -- 172.21.15.160:0/1818373296 <== mon.0 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c01b070 con 0x5606b395e0e0 2022-03-21T13:55:02.131 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f43597fa700 1 -- 172.21.15.160:0/1818373296 <== mon.0 v2:172.21.15.160:3300/0 5 ==== fsmap(e 17) v1 ==== 4238+0+0 (secure 0 0 0) 0x7f436403d070 con 0x5606b395e0e0 2022-03-21T13:55:02.131 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f438b17ab80 10 client.4731 fetch_fsmap finished waiting for FSMap version 17 2022-03-21T13:55:02.131 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f438b17ab80 10 client.4731 resolve_mds: resolved name 'f' to daemon mds.f 2022-03-21T13:55:02.131 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f438b17ab80 20 client.4731 populate_metadata read hostname 'smithi160' 2022-03-21T13:55:02.132 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:6836/4225939003,v1:172.21.15.171:6837/4225939003] conn(0x5606b3993170 0x5606b3993540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.132 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f438b17ab80 4 client.4731 mds_command: new command op to 4294 tid=0[{"prefix": "status"}] 2022-03-21T13:55:02.132 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f438b17ab80 1 -- 172.21.15.160:0/1818373296 --> [v2:172.21.15.171:6836/4225939003,v1:172.21.15.171:6837/4225939003] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5606b386b5f0 con 0x5606b3993170 2022-03-21T13:55:02.132 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.096+0000 7f437affd700 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:6836/4225939003,v1:172.21.15.171:6837/4225939003] conn(0x5606b3993170 0x5606b3993540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.133 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f43597fa700 10 client.4731 ms_handle_connect on v2:172.21.15.171:6836/4225939003 2022-03-21T13:55:02.133 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f437affd700 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:6836/4225939003,v1:172.21.15.171:6837/4225939003] conn(0x5606b3993170 0x5606b3993540 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b6d834117d3ea3a server_cookie=380d5ea28b4b3f44 in_seq=0 out_seq=0 2022-03-21T13:55:02.133 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f43597fa700 1 -- 172.21.15.160:0/1818373296 <== mds.0 v2:172.21.15.171:6836/4225939003 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5606b386b5f0 con 0x5606b3993170 2022-03-21T13:55:02.133 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f43597fa700 10 client.4731 handle_command_reply: tid=0 2022-03-21T13:55:02.134 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 1 client.4731 shutdown 2022-03-21T13:55:02.134 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 1 -- 172.21.15.160:0/1818373296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 msgr2=0x5606b39feb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.134 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39feb10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4364006c40 tx=0x7f4364023000 comp rx=0 tx=0).stop 2022-03-21T13:55:02.134 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 1 -- 172.21.15.160:0/1818373296 shutdown_connections 2022-03-21T13:55:02.134 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:6836/4225939003,v1:172.21.15.171:6837/4225939003] conn(0x5606b3993170 0x5606b3993540 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.135 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606b395ea00 0x5606b39589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.135 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f43597fa700 0 client.4731 ms_handle_reset on v2:172.21.15.171:6836/4225939003 2022-03-21T13:55:02.135 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5606b395dd10 0x5606b395f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.135 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 1 --2- 172.21.15.160:0/1818373296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5606b395e0e0 0x5606b39feb10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.136 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 1 -- 172.21.15.160:0/1818373296 >> 172.21.15.160:0/1818373296 conn(0x5606b395d770 msgr2=0x5606b39a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:02.136 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 1 -- 172.21.15.160:0/1818373296 shutdown_connections 2022-03-21T13:55:02.136 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 1 -- 172.21.15.160:0/1818373296 wait complete. 2022-03-21T13:55:02.136 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.097+0000 7f438b17ab80 20 client.4731 trim_cache size 0 max 16384 2022-03-21T13:55:02.137 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2022-03-21T13:55:02.137 INFO:teuthology.orchestra.run.smithi160.stdout: "cluster_fsid": "b2a3ddc8-064e-4cc9-8187-33ea19afd50a", 2022-03-21T13:55:02.137 INFO:teuthology.orchestra.run.smithi160.stdout: "whoami": 0, 2022-03-21T13:55:02.138 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 4294, 2022-03-21T13:55:02.138 INFO:teuthology.orchestra.run.smithi160.stdout: "want_state": "up:active", 2022-03-21T13:55:02.138 INFO:teuthology.orchestra.run.smithi160.stdout: "state": "up:active", 2022-03-21T13:55:02.138 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs", 2022-03-21T13:55:02.139 INFO:teuthology.orchestra.run.smithi160.stdout: "rank_uptime": 34.561690757000001, 2022-03-21T13:55:02.139 INFO:teuthology.orchestra.run.smithi160.stdout: "mdsmap_epoch": 17, 2022-03-21T13:55:02.139 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_epoch": 20, 2022-03-21T13:55:02.139 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_epoch_barrier": 20, 2022-03-21T13:55:02.139 INFO:teuthology.orchestra.run.smithi160.stdout: "uptime": 39.457249699999998 2022-03-21T13:55:02.140 INFO:teuthology.orchestra.run.smithi160.stdout:} 2022-03-21T13:55:02.141 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 -- 172.21.15.160:0/1039124267 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4360063ce0 msgr2=0x7f4360066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.142 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4360063ce0 0x7f4360066190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f436c009fd0 tx=0x7f436c00b040 comp rx=0 tx=0).stop 2022-03-21T13:55:02.142 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 -- 172.21.15.160:0/1039124267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f437c1664e0 msgr2=0x7f437c166910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.142 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f437c1664e0 0x7f437c166910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f437400c4c0 tx=0x7f4374007d70 comp rx=0 tx=0).stop 2022-03-21T13:55:02.143 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 -- 172.21.15.160:0/1039124267 shutdown_connections 2022-03-21T13:55:02.143 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f4360063ce0 0x7f4360066190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.143 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f437c1664e0 0x7f437c166910 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.143 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f437c0c45d0 0x7f437c155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.144 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 --2- 172.21.15.160:0/1039124267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f437c0c49a0 0x7f437c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.144 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 -- 172.21.15.160:0/1039124267 >> 172.21.15.160:0/1039124267 conn(0x7f437c068650 msgr2=0x7f437c06c070 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:02.144 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 -- 172.21.15.160:0/1039124267 shutdown_connections 2022-03-21T13:55:02.144 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.098+0000 7f4381809700 1 -- 172.21.15.160:0/1039124267 wait complete. 2022-03-21T13:55:02.145 INFO:teuthology.run_tasks:Running task kclient... 2022-03-21T13:55:02.166 INFO:tasks.kclient:Mounting kernel clients... 2022-03-21T13:55:02.167 INFO:tasks.kclient:config is {'client.0': {}} 2022-03-21T13:55:02.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:02.168 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2022-03-21T13:55:02.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:02.184 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link delete ceph-brx 2022-03-21T13:55:02.249 INFO:teuthology.orchestra.run.smithi160.stderr:Cannot find device "ceph-brx" 2022-03-21T13:55:02.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-03-21T13:55:02.251 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2022-03-21T13:55:02.251 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2022-03-21T13:55:02.405 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.404+0000 7f3dc2889700 1 Processor -- start 2022-03-21T13:55:02.406 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.404+0000 7f3dc2889700 1 -- start start 2022-03-21T13:55:02.411 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.405+0000 7f3dc2889700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3dbc0c0440 0x7f3dbc06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.411 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.405+0000 7f3dc2889700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3dbc0c7840 0x7f3dbc155f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.411 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.405+0000 7f3dc2889700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dbc0c0810 0x7f3dbc1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.405+0000 7f3dc2889700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dbc0c2360 con 0x7f3dbc0c7840 2022-03-21T13:55:02.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.405+0000 7f3dc2889700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dbc0ace90 con 0x7f3dbc0c0440 2022-03-21T13:55:02.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.405+0000 7f3dc2889700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc0c15f0 con 0x7f3dbc0c0810 2022-03-21T13:55:02.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.405+0000 7f3dbb7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3dbc0c7840 0x7f3dbc155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.412 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.405+0000 7f3dbb7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3dbc0c7840 0x7f3dbc155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57272/0 (socket says 172.21.15.160:57272) 2022-03-21T13:55:02.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.405+0000 7f3dbb7fe700 1 -- 172.21.15.160:0/3175430330 learned_addr learned my addr 172.21.15.160:0/3175430330 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:02.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.405+0000 7f3dc0e26700 1 --2- 172.21.15.160:0/3175430330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dbc0c0810 0x7f3dbc1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dbbfff700 1 --2- 172.21.15.160:0/3175430330 >> v2:172.21.15.171:3300/0 conn(0x7f3dbc0c0440 0x7f3dbc06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.413 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dbb7fe700 1 -- 172.21.15.160:0/3175430330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dbc0c0810 msgr2=0x7f3dbc1564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:02.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dbb7fe700 1 --2- 172.21.15.160:0/3175430330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dbc0c0810 0x7f3dbc1564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dbb7fe700 1 -- 172.21.15.160:0/3175430330 >> v2:172.21.15.171:3300/0 conn(0x7f3dbc0c0440 msgr2=0x7f3dbc06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-21T13:55:02.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dbb7fe700 1 --2- 172.21.15.160:0/3175430330 >> v2:172.21.15.171:3300/0 conn(0x7f3dbc0c0440 0x7f3dbc06c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.414 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dbb7fe700 1 -- 172.21.15.160:0/3175430330 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc06b570 con 0x7f3dbc0c7840 2022-03-21T13:55:02.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dbb7fe700 1 --2- 172.21.15.160:0/3175430330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0c7840 0x7f3dbc155f60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc06b0a0 tx=0x7f3db00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4735d3ec210255dc server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:02.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dbaffd700 1 -- 172.21.15.160:0/3175430330 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0004030 con 0x7f3dbc0c7840 2022-03-21T13:55:02.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dbaffd700 1 -- 172.21.15.160:0/3175430330 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db00041d0 con 0x7f3dbc0c7840 2022-03-21T13:55:02.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dbaffd700 1 -- 172.21.15.160:0/3175430330 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0011630 con 0x7f3dbc0c7840 2022-03-21T13:55:02.415 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dc2889700 1 -- 172.21.15.160:0/3175430330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0c7840 msgr2=0x7f3dbc155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.416 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dc2889700 1 --2- 172.21.15.160:0/3175430330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0c7840 0x7f3dbc155f60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc06b0a0 tx=0x7f3db00090f0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.416 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dc2889700 1 -- 172.21.15.160:0/3175430330 shutdown_connections 2022-03-21T13:55:02.416 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dc2889700 1 --2- 172.21.15.160:0/3175430330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dbc0c0810 0x7f3dbc1564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.416 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dc2889700 1 --2- 172.21.15.160:0/3175430330 >> v2:172.21.15.171:3300/0 conn(0x7f3dbc0c0440 0x7f3dbc06c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dc2889700 1 --2- 172.21.15.160:0/3175430330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0c7840 0x7f3dbc155f60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dc2889700 1 -- 172.21.15.160:0/3175430330 >> 172.21.15.160:0/3175430330 conn(0x7f3dbc068620 msgr2=0x7f3dbc0c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:02.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dc2889700 1 -- 172.21.15.160:0/3175430330 shutdown_connections 2022-03-21T13:55:02.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.406+0000 7f3dc2889700 1 -- 172.21.15.160:0/3175430330 wait complete. 2022-03-21T13:55:02.417 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.407+0000 7f3dc2889700 1 Processor -- start 2022-03-21T13:55:02.418 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.408+0000 7f3dc2889700 1 -- start start 2022-03-21T13:55:02.418 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.408+0000 7f3dc2889700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0c0440 0x7f3dbc0bd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.418 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.408+0000 7f3dc2889700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3dbc0c0810 0x7f3dbc1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.418 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.408+0000 7f3dc2889700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dbc0c7840 0x7f3dbc0bb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.419 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.408+0000 7f3dc2889700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc0bf4f0 con 0x7f3dbc0c0440 2022-03-21T13:55:02.419 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.408+0000 7f3dc2889700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc0bdcd0 con 0x7f3dbc0c0810 2022-03-21T13:55:02.419 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.408+0000 7f3dc2889700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc0bf230 con 0x7f3dbc0c7840 2022-03-21T13:55:02.419 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.408+0000 7f3dbbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0c0440 0x7f3dbc0bd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.419 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.408+0000 7f3dbbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0c0440 0x7f3dbc0bd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57274/0 (socket says 172.21.15.160:57274) 2022-03-21T13:55:02.420 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.408+0000 7f3dbbfff700 1 -- 172.21.15.160:0/1112064816 learned_addr learned my addr 172.21.15.160:0/1112064816 (peer_addr_for_me v2:172.21.15.160:0/0) 2022-03-21T13:55:02.420 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3dbb7fe700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3dbc0c0810 0x7f3dbc1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.420 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3dc0e26700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dbc0c7840 0x7f3dbc0bb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.420 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3dbbfff700 1 -- 172.21.15.160:0/1112064816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dbc0c7840 msgr2=0x7f3dbc0bb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.421 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3dbbfff700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dbc0c7840 0x7f3dbc0bb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.421 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3dbbfff700 1 -- 172.21.15.160:0/1112064816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3dbc0c0810 msgr2=0x7f3dbc1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.421 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3dbbfff700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3dbc0c0810 0x7f3dbc1565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.421 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3dbbfff700 1 -- 172.21.15.160:0/1112064816 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db0009370 con 0x7f3dbc0c0440 2022-03-21T13:55:02.422 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3dc0e26700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dbc0c7840 0x7f3dbc0bb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-21T13:55:02.422 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3dbbfff700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0c0440 0x7f3dbc0bd610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00d890 tx=0x7f3dac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:02.422 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3da3fff700 1 -- 172.21.15.160:0/1112064816 <== mon.0 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac014620 con 0x7f3dbc0c0440 2022-03-21T13:55:02.422 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3da3fff700 1 -- 172.21.15.160:0/1112064816 <== mon.0 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac014780 con 0x7f3dbc0c0440 2022-03-21T13:55:02.422 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3dc2889700 1 -- 172.21.15.160:0/1112064816 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc0ba9c0 con 0x7f3dbc0c0440 2022-03-21T13:55:02.423 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3da3fff700 1 -- 172.21.15.160:0/1112064816 <== mon.0 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac014b40 con 0x7f3dbc0c0440 2022-03-21T13:55:02.423 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.409+0000 7f3dc2889700 1 -- 172.21.15.160:0/1112064816 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc0baf80 con 0x7f3dbc0c0440 2022-03-21T13:55:02.423 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.410+0000 7f3dc2889700 1 -- 172.21.15.160:0/1112064816 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc070ae0 con 0x7f3dbc0c0440 2022-03-21T13:55:02.423 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.410+0000 7f3da3fff700 1 -- 172.21.15.160:0/1112064816 <== mon.0 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f3dac01d400 con 0x7f3dbc0c0440 2022-03-21T13:55:02.424 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.411+0000 7f3da3fff700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3d9c063ce0 0x7f3d9c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-21T13:55:02.425 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.411+0000 7f3da3fff700 1 -- 172.21.15.160:0/1112064816 <== mon.0 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3dac080df0 con 0x7f3dbc0c0440 2022-03-21T13:55:02.425 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.411+0000 7f3dbb7fe700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3d9c063ce0 0x7f3d9c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-21T13:55:02.425 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.411+0000 7f3dbb7fe700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3d9c063ce0 0x7f3d9c066190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009340 tx=0x7f3db0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-21T13:55:02.425 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.415+0000 7f3da3fff700 1 -- 172.21.15.160:0/1112064816 <== mon.0 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f3dac04f970 con 0x7f3dbc0c0440 2022-03-21T13:55:02.626 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.625+0000 7f3dc2889700 1 -- 172.21.15.160:0/1112064816 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3dbc0acbb0 con 0x7f3dbc0c0440 2022-03-21T13:55:02.626 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.625+0000 7f3da3fff700 1 -- 172.21.15.160:0/1112064816 <== mon.0 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3dac052f90 con 0x7f3dbc0c0440 2022-03-21T13:55:02.627 INFO:teuthology.orchestra.run.smithi160.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2022-03-21T13:55:02.628 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 -- 172.21.15.160:0/1112064816 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3d9c063ce0 msgr2=0x7f3d9c066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.629 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3d9c063ce0 0x7f3d9c066190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009340 tx=0x7f3db0016000 comp rx=0 tx=0).stop 2022-03-21T13:55:02.629 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 -- 172.21.15.160:0/1112064816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0c0440 msgr2=0x7f3dbc0bd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-21T13:55:02.629 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0c0440 0x7f3dbc0bd610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00d890 tx=0x7f3dac008040 comp rx=0 tx=0).stop 2022-03-21T13:55:02.629 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 -- 172.21.15.160:0/1112064816 shutdown_connections 2022-03-21T13:55:02.629 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.160:6832/25205,v1:172.21.15.160:6833/25205] conn(0x7f3d9c063ce0 0x7f3d9c066190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.630 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dbc0c7840 0x7f3dbc0bb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.630 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0c0440 0x7f3dbc0bd610 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.630 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 --2- 172.21.15.160:0/1112064816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3dbc0c0810 0x7f3dbc1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-21T13:55:02.630 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 -- 172.21.15.160:0/1112064816 >> 172.21.15.160:0/1112064816 conn(0x7f3dbc068620 msgr2=0x7f3dbc0c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-21T13:55:02.631 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 -- 172.21.15.160:0/1112064816 shutdown_connections 2022-03-21T13:55:02.631 INFO:teuthology.orchestra.run.smithi160.stderr:2022-03-21T13:55:02.627+0000 7f3dc2889700 1 -- 172.21.15.160:0/1112064816 wait complete. 2022-03-21T13:55:02.640 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2022-03-21T13:55:02.640 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-03-21T13:55:02.640 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2022-03-21T13:55:02.641 INFO:tasks.cephfs.mount:self.client.name = client.0 2022-03-21T13:55:02.641 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-03-21T13:55:02.641 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-03-21T13:55:02.642 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-03-21T13:55:02.642 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-03-21T13:55:02.642 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2022-03-21T13:55:02.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:02.643 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2022-03-21T13:55:02.658 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-03-21T13:55:02.658 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-03-21T13:55:02.658 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2022-03-21T13:55:02.659 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2022-03-21T13:55:02.659 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2022-03-21T13:55:02.659 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2022-03-21T13:55:02.659 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-03-21T13:55:02.660 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2022-03-21T13:55:02.660 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-03-21T13:55:02.660 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2022-03-21T13:55:02.660 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-03-21T13:55:02.660 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2022-03-21T13:55:02.661 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-03-21T13:55:02.661 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2022-03-21T13:55:02.661 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-03-21T13:55:02.661 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42658sec preferred_lft 42658sec 2022-03-21T13:55:02.662 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link 2022-03-21T13:55:02.662 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2022-03-21T13:55:02.662 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-03-21T13:55:02.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:02.663 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2022-03-21T13:55:02.664 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2022-03-21T13:55:02.664 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link add name ceph-brx type bridge 2022-03-21T13:55:02.664 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip addr flush dev ceph-brx 2022-03-21T13:55:02.664 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set ceph-brx up 2022-03-21T13:55:02.665 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-03-21T13:55:02.665 DEBUG:teuthology.orchestra.run.smithi160:> ') 2022-03-21T13:55:02.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:02.806 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-03-21T13:55:02.842 INFO:teuthology.orchestra.run.smithi160.stdout:1 2022-03-21T13:55:02.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:02.844 DEBUG:teuthology.orchestra.run.smithi160:> route 2022-03-21T13:55:02.937 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2022-03-21T13:55:02.937 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-03-21T13:55:02.937 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-03-21T13:55:02.937 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-03-21T13:55:02.938 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-03-21T13:55:02.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:02.939 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2022-03-21T13:55:02.939 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2022-03-21T13:55:02.939 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-03-21T13:55:02.940 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-03-21T13:55:02.940 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-03-21T13:55:02.940 DEBUG:teuthology.orchestra.run.smithi160:> ') 2022-03-21T13:55:03.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:03.104 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2022-03-21T13:55:03.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:03.119 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list-id 2022-03-21T13:55:03.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:03.174 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2022-03-21T13:55:03.174 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2022-03-21T13:55:03.174 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2022-03-21T13:55:03.174 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2022-03-21T13:55:03.175 DEBUG:teuthology.orchestra.run.smithi160:> ') 2022-03-21T13:55:03.261 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2022-03-21T13:55:03.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:03.262 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2022-03-21T13:55:03.262 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2022-03-21T13:55:03.263 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2022-03-21T13:55:03.263 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-03-21T13:55:03.263 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2022-03-21T13:55:03.264 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2022-03-21T13:55:03.264 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2022-03-21T13:55:03.264 DEBUG:teuthology.orchestra.run.smithi160:> ') 2022-03-21T13:55:03.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:03.499 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2022-03-21T13:55:03.499 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2022-03-21T13:55:03.500 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2022-03-21T13:55:03.500 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set dev brx.0 master ceph-brx 2022-03-21T13:55:03.500 DEBUG:teuthology.orchestra.run.smithi160:> ') 2022-03-21T13:55:03.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-03-21T13:55:03.608 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2022-03-21T13:55:03.627 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2022-03-21T13:55:03.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-03-21T13:55:03.628 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2022-03-21T13:55:03.681 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2022-03-21T13:55:03.682 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-03-21T13:55:03.682 DEBUG:teuthology.orchestra.run.smithi160:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2022-03-21T13:55:03.807 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2022-03-21T13:55:03.808 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2022-03-21T13:55:03.931 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2022-03-21T13:55:03.932 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2022-03-21T13:55:03.932 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: trying mount with new device syntax: 0@b2a3ddc8-064e-4cc9-8187-33ea19afd50a.cephfs=/ 2022-03-21T13:55:03.932 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.160:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2022-03-21T13:55:03.932 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: v2 mount support check returned 2 2022-03-21T13:55:03.933 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: kernel does not support v2 syntax 2022-03-21T13:55:03.933 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.160:3300,172.21.15.171:3300,172.21.15.171:3301:/ 2022-03-21T13:55:03.933 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mds_namespace=cephfs,fsid=b2a3ddc8-064e-4cc9-8187-33ea19afd50a" will pass to kernel 2022-03-21T13:55:03.935 INFO:tasks.cephfs.kernel_mount:mount command passed 2022-03-21T13:55:03.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-21T13:55:03.936 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-03-21T13:55:06.373 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:55:06.376 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:55:36.432 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:55:36.435 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:56:06.916 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:56:06.919 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:56:36.981 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:56:36.984 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:57:07.052 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:57:07.055 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:57:37.487 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:57:37.489 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:58:07.574 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:58:07.577 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:58:38.138 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:58:38.140 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:59:08.237 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:59:08.240 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T13:59:08.306 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T13:59:08.304+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30331) UID: 0 2022-03-21T13:59:08.307 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T13:59:08.304+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30331) UID: 0 2022-03-21T13:59:08.307 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T13:59:08.304+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30331) UID: 0 2022-03-21T14:00:03.943 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-03-21T14:00:03.945 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-03-21T14:01:14.084 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:01:14.088 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:01:44.164 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:01:44.167 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:02:14.647 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:02:14.651 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:02:44.720 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:02:44.724 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:03:14.796 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:03:14.799 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:03:14.840 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:03:14.839+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30474) UID: 0 2022-03-21T14:03:14.840 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:03:14.839+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30474) UID: 0 2022-03-21T14:03:14.841 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:03:14.839+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30474) UID: 0 2022-03-21T14:05:18.444 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:05:18.448 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:05:48.533 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:05:48.536 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:06:18.870 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:06:18.873 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:06:48.943 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:06:48.947 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:07:19.031 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:07:19.034 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:07:19.071 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:07:19.069+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30594) UID: 0 2022-03-21T14:07:19.071 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:07:19.069+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30594) UID: 0 2022-03-21T14:07:19.072 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:07:19.069+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30594) UID: 0 2022-03-21T14:09:22.397 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:09:22.400 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:09:52.459 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:09:52.463 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:10:22.816 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:10:22.819 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:10:53.201 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:10:53.204 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:11:23.281 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:11:23.285 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:11:23.322 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:11:23.322+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30718) UID: 0 2022-03-21T14:11:23.323 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:11:23.322+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30718) UID: 0 2022-03-21T14:11:23.323 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:11:23.322+0000 7f69077c3700 -1 Fail to open '/proc/30718/cmdline' error = (2) No such file or directory 2022-03-21T14:11:23.323 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:11:23.322+0000 7f69077c3700 -1 received signal: Hangup from (PID: 30718) UID: 0 2022-03-21T14:13:27.041 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:13:27.079 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:13:57.192 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:13:57.195 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:14:27.280 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:14:27.283 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:14:57.340 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:14:57.343 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:15:27.405 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:15:27.407 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:15:27.456 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:15:27.455+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30838) UID: 0 2022-03-21T14:15:27.457 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:15:27.455+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30838) UID: 0 2022-03-21T14:15:27.457 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:15:27.455+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30838) UID: 0 2022-03-21T14:17:31.361 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:17:31.365 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:18:01.418 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:18:01.421 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:18:31.753 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:18:31.761 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:19:01.819 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:19:01.822 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:19:32.252 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:19:32.255 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:19:32.306 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:19:32.304+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30967) UID: 0 2022-03-21T14:19:32.306 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:19:32.305+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30967) UID: 0 2022-03-21T14:19:32.307 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:19:32.305+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 30967) UID: 0 2022-03-21T14:21:35.808 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:21:35.823 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:21:35.897 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:21:35.895+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31008) UID: 0 2022-03-21T14:21:35.898 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:21:35.895+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31008) UID: 0 2022-03-21T14:21:35.899 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:21:35.895+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31008) UID: 0 2022-03-21T14:23:40.415 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:23:40.419 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:23:40.457 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:23:40.456+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31052) UID: 0 2022-03-21T14:23:40.457 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:23:40.456+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31052) UID: 0 2022-03-21T14:23:40.458 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:23:40.456+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31052) UID: 0 2022-03-21T14:25:44.087 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:25:44.091 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:25:44.127 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:25:44.125+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31088) UID: 0 2022-03-21T14:25:44.127 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:25:44.125+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31088) UID: 0 2022-03-21T14:25:44.128 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:25:44.125+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31088) UID: 0 2022-03-21T14:25:44.213 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T14:25:44.212+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34329) UID: 0 2022-03-21T14:25:44.213 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T14:25:44.212+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34329) UID: 0 2022-03-21T14:25:44.214 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T14:25:44.212+0000 7f6398c04700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34329) UID: 0 2022-03-21T14:28:31.874 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:28:31.878 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:28:31.924 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:28:31.923+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31124) UID: 0 2022-03-21T14:28:31.925 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:28:31.923+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31124) UID: 0 2022-03-21T14:28:31.925 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:28:31.923+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31124) UID: 0 2022-03-21T14:30:50.930 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:30:50.934 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:31:21.077 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:31:21.079 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:31:51.482 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:31:51.485 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:32:21.671 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:32:21.674 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:32:52.029 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:32:52.032 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:32:52.070 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:32:52.069+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31257) UID: 0 2022-03-21T14:32:52.071 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:32:52.069+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31257) UID: 0 2022-03-21T14:32:52.071 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:32:52.069+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31257) UID: 0 2022-03-21T14:35:01.608 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:35:01.613 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:35:31.752 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:35:31.755 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:36:02.139 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:36:02.142 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:36:32.263 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:36:32.266 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:37:02.698 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:37:02.701 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:37:02.738 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:37:02.736+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31377) UID: 0 2022-03-21T14:37:02.739 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:37:02.737+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31377) UID: 0 2022-03-21T14:37:02.739 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:37:02.736+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31377) UID: 0 2022-03-21T14:39:08.659 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:39:08.662 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:39:38.906 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:39:38.909 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:40:08.963 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:40:08.966 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:40:39.060 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:40:39.063 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:41:09.485 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:41:09.488 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:41:09.528 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:41:09.527+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31504) UID: 0 2022-03-21T14:41:09.529 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:41:09.527+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31504) UID: 0 2022-03-21T14:41:09.529 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:41:09.527+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31504) UID: 0 2022-03-21T14:43:14.975 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:43:14.978 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:43:45.043 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:43:45.047 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:44:15.568 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:44:15.571 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:44:45.623 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:44:45.626 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:45:16.180 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:45:16.183 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:45:16.239 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:45:16.238+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31625) UID: 0 2022-03-21T14:45:16.240 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:45:16.238+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31625) UID: 0 2022-03-21T14:45:16.240 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:45:16.238+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31625) UID: 0 2022-03-21T14:47:21.335 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:47:21.338 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:47:51.448 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:47:51.451 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:47:51.488 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:47:51.487+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31686) UID: 0 2022-03-21T14:47:51.489 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:47:51.487+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31686) UID: 0 2022-03-21T14:47:51.489 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:47:51.487+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31686) UID: 0 2022-03-21T14:50:00.393 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:50:00.396 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:50:00.444 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:50:00.442+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31723) UID: 0 2022-03-21T14:50:00.445 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:50:00.442+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31723) UID: 0 2022-03-21T14:50:00.445 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:50:00.442+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31723) UID: 0 2022-03-21T14:51:44.432 INFO:teuthology.orchestra.run.smithi171.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.f.log.1: 2022-03-21T14:51:44.434 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: stdin: file size changed while zipping 2022-03-21T14:52:16.512 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:52:16.518 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:52:46.656 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:52:46.660 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:53:17.146 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:53:17.150 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:53:47.500 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:53:47.503 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:54:17.763 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:54:17.766 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:54:17.805 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:54:17.804+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31846) UID: 0 2022-03-21T14:54:17.805 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:54:17.804+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31846) UID: 0 2022-03-21T14:54:17.806 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:54:17.805+0000 7f69077c3700 -1 Fail to open '/proc/31846/cmdline' error = (2) No such file or directory 2022-03-21T14:54:17.806 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:54:17.805+0000 7f69077c3700 -1 received signal: Hangup from (PID: 31846) UID: 0 2022-03-21T14:56:28.101 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:56:28.104 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:56:28.138 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T14:56:28.137+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35249) UID: 0 2022-03-21T14:56:28.139 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T14:56:28.137+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35249) UID: 0 2022-03-21T14:56:28.139 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T14:56:28.137+0000 7f6398c04700 -1 Fail to open '/proc/35249/cmdline' error = (2) No such file or directory 2022-03-21T14:56:28.139 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T14:56:28.137+0000 7f6398c04700 -1 received signal: Hangup from (PID: 35249) UID: 0 2022-03-21T14:56:28.141 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:56:28.140+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31883) UID: 0 2022-03-21T14:56:28.142 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:56:28.140+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31883) UID: 0 2022-03-21T14:56:28.142 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:56:28.140+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31883) UID: 0 2022-03-21T14:59:14.505 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:59:14.540 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T14:59:14.590 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T14:59:14.588+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31930) UID: 0 2022-03-21T14:59:14.591 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T14:59:14.589+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31930) UID: 0 2022-03-21T14:59:14.591 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T14:59:14.589+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31930) UID: 0 2022-03-21T15:01:36.305 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:01:36.312 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:02:06.720 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:02:06.724 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:02:37.013 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:02:37.016 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:03:07.114 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:03:07.117 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:03:37.459 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:03:37.462 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:03:37.501 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:03:37.500+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32066) UID: 0 2022-03-21T15:03:37.502 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:03:37.500+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32066) UID: 0 2022-03-21T15:03:37.502 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:03:37.500+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32066) UID: 0 2022-03-21T15:05:47.000 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:05:47.003 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:06:17.263 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:06:17.266 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:06:47.313 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:06:47.316 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:07:17.369 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:07:17.372 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:07:47.824 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:07:47.827 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:07:47.863 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:07:47.862+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32194) UID: 0 2022-03-21T15:07:47.864 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:07:47.862+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32194) UID: 0 2022-03-21T15:07:47.864 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:07:47.862+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32194) UID: 0 2022-03-21T15:09:25.127 INFO:tasks.ceph.mds.f.smithi171.stderr:tcmalloc: large alloc 1677721600 bytes == 0x55d1094d0000 @ 0x7f690f38d760 0x7f690f3aec64 0x55d0a2dc57bd 0x55d0a2dc0bb6 0x55d0a2c56179 0x55d0a2c49ca8 0x55d0a2aafb9a 0x55d0a2afa7cb 0x55d0a2ba372c 0x55d0a2d73443 0x55d0a2d95347 0x55d0a2c3f326 0x55d0a2c4472a 0x55d0a2c4df0a 0x55d0a2c51f34 0x55d0a2a509c4 0x55d0a2a535fb 0x55d0a2a53c1c 0x55d0a2a42b18 0x7f690ea66dea 0x7f690eb1e411 0x7f690d7b814a 0x7f690c2d1dc3 2022-03-21T15:09:53.595 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:09:53.598 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:10:24.925 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:10:24.928 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:10:55.004 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:10:55.007 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:11:25.352 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:11:25.355 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:11:55.729 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:11:55.732 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:11:55.770 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:11:55.770+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32319) UID: 0 2022-03-21T15:11:55.771 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:11:55.770+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32319) UID: 0 2022-03-21T15:11:55.771 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:11:55.770+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32319) UID: 0 2022-03-21T15:14:00.007 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:14:00.038 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:14:30.155 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:14:30.159 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:14:30.211 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:14:30.211+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32372) UID: 0 2022-03-21T15:14:30.212 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:14:30.211+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32372) UID: 0 2022-03-21T15:14:30.212 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:14:30.211+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32372) UID: 0 2022-03-21T15:16:44.900 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:16:44.903 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:16:44.954 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:16:44.952+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32416) UID: 0 2022-03-21T15:16:44.954 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:16:44.952+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32416) UID: 0 2022-03-21T15:16:44.955 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:16:44.952+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32416) UID: 0 2022-03-21T15:19:03.946 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:19:03.950 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:19:34.274 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:19:34.277 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:20:04.348 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:20:04.352 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:20:34.437 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:20:34.440 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:21:04.527 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:21:04.530 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:21:04.568 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:21:04.566+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32540) UID: 0 2022-03-21T15:21:04.569 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:21:04.566+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32540) UID: 0 2022-03-21T15:21:04.569 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:21:04.566+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32540) UID: 0 2022-03-21T15:23:14.264 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:23:14.268 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:23:44.327 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:23:44.330 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:24:14.690 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:24:14.694 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:24:44.740 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:24:44.743 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:25:14.863 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:25:14.866 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:25:14.902 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:25:14.902+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32660) UID: 0 2022-03-21T15:25:14.903 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:25:14.902+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32660) UID: 0 2022-03-21T15:25:14.903 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:25:14.902+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32660) UID: 0 2022-03-21T15:27:20.701 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:27:20.705 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:27:20.738 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T15:27:20.738+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36229) UID: 0 2022-03-21T15:27:20.739 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T15:27:20.738+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36229) UID: 0 2022-03-21T15:27:20.739 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T15:27:20.738+0000 7f6398c04700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36229) UID: 0 2022-03-21T15:27:20.740 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:27:20.739+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32696) UID: 0 2022-03-21T15:27:20.741 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:27:20.739+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32696) UID: 0 2022-03-21T15:27:20.741 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:27:20.739+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32696) UID: 0 2022-03-21T15:30:08.056 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:30:08.060 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:30:08.108 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:30:08.106+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32744) UID: 0 2022-03-21T15:30:08.109 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:30:08.106+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32744) UID: 0 2022-03-21T15:30:08.110 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:30:08.106+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32744) UID: 0 2022-03-21T15:32:27.927 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:32:27.930 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:32:57.986 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:32:57.989 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:33:28.271 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:33:28.274 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:33:58.353 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:33:58.356 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:34:28.726 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:34:28.729 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:34:28.765 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:34:28.763+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32864) UID: 0 2022-03-21T15:34:28.766 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:34:28.763+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32864) UID: 0 2022-03-21T15:34:28.766 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:34:28.763+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32864) UID: 0 2022-03-21T15:36:40.023 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:36:40.026 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:37:10.118 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:37:10.121 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:37:40.266 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:37:40.269 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:38:10.380 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:38:10.383 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:38:40.653 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:38:40.656 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:38:40.693 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:38:40.692+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32984) UID: 0 2022-03-21T15:38:40.694 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:38:40.692+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32984) UID: 0 2022-03-21T15:38:40.694 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:38:40.692+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32984) UID: 0 2022-03-21T15:40:46.424 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:40:46.428 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:40:46.554 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:40:46.552+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33032) UID: 0 2022-03-21T15:40:46.554 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:40:46.552+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33032) UID: 0 2022-03-21T15:40:46.555 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:40:46.552+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33032) UID: 0 2022-03-21T15:42:44.311 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:42:44.315 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:43:14.650 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:43:14.653 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:43:14.689 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:43:14.688+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33085) UID: 0 2022-03-21T15:43:14.690 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:43:14.688+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33085) UID: 0 2022-03-21T15:43:14.690 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:43:14.688+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33085) UID: 0 2022-03-21T15:45:26.937 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:45:26.941 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:45:57.082 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:45:57.085 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:46:27.333 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:46:27.336 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:46:57.387 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:46:57.390 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:47:27.669 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:47:27.672 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:47:27.708 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:47:27.707+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33205) UID: 0 2022-03-21T15:47:27.708 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:47:27.707+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33205) UID: 0 2022-03-21T15:47:27.709 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:47:27.707+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33205) UID: 0 2022-03-21T15:49:35.147 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:49:35.154 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:50:05.310 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:50:05.313 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:50:35.655 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:50:35.844 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:51:06.130 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:51:06.133 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:51:36.239 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:51:36.242 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:51:36.281 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:51:36.280+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33329) UID: 0 2022-03-21T15:51:36.281 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:51:36.280+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33329) UID: 0 2022-03-21T15:51:36.282 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:51:36.280+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33329) UID: 0 2022-03-21T15:53:41.039 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:53:41.043 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:54:11.160 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:54:11.163 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:54:41.462 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:54:41.465 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:55:11.534 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:55:11.537 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:55:41.965 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:55:41.967 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:55:42.004 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T15:55:42.003+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33449) UID: 0 2022-03-21T15:55:42.004 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T15:55:42.003+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33449) UID: 0 2022-03-21T15:55:42.005 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T15:55:42.003+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33449) UID: 0 2022-03-21T15:57:46.953 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:57:46.957 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T15:57:46.988 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T15:57:46.986+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37011) UID: 0 2022-03-21T15:57:46.988 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T15:57:46.986+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37011) UID: 0 2022-03-21T15:57:46.989 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T15:57:46.986+0000 7f6398c04700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37011) UID: 0 2022-03-21T16:00:33.977 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:00:33.981 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:00:34.040 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:00:34.038+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33728) UID: 0 2022-03-21T16:00:34.043 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:00:34.038+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33728) UID: 0 2022-03-21T16:00:34.043 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:00:34.038+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33728) UID: 0 2022-03-21T16:05:19.017 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:05:19.023 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:05:19.105 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:05:19.103+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33800) UID: 0 2022-03-21T16:05:19.106 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:05:19.103+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33800) UID: 0 2022-03-21T16:05:19.106 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:05:19.103+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33800) UID: 0 2022-03-21T16:07:34.166 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:07:34.169 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:07:34.217 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:07:34.216+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33836) UID: 0 2022-03-21T16:07:34.218 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:07:34.216+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33836) UID: 0 2022-03-21T16:07:34.219 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:07:34.217+0000 7f69077c3700 -1 Fail to open '/proc/33836/cmdline' error = (2) No such file or directory 2022-03-21T16:07:34.219 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:07:34.217+0000 7f69077c3700 -1 received signal: Hangup from (PID: 33836) UID: 0 2022-03-21T16:10:02.423 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:10:02.427 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:10:02.470 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:10:02.467+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33975) UID: 0 2022-03-21T16:10:02.470 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:10:02.467+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33975) UID: 0 2022-03-21T16:10:02.471 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:10:02.467+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 33975) UID: 0 2022-03-21T16:12:17.945 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:12:17.948 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:12:48.075 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:12:48.078 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:13:18.384 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:13:18.387 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:13:48.450 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:13:48.454 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:14:18.807 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:14:18.810 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:14:18.849 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:14:18.846+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34098) UID: 0 2022-03-21T16:14:18.849 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:14:18.846+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34098) UID: 0 2022-03-21T16:14:18.850 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:14:18.847+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34098) UID: 0 2022-03-21T16:16:26.512 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:16:26.516 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:16:56.806 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:16:56.809 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:17:27.173 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:17:27.177 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:17:57.225 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:17:57.229 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:18:28.094 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:18:28.097 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:18:28.136 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:18:28.133+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34218) UID: 0 2022-03-21T16:18:28.137 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:18:28.133+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34218) UID: 0 2022-03-21T16:18:28.137 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:18:28.133+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34218) UID: 0 2022-03-21T16:20:34.205 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:20:34.235 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:21:04.288 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:21:04.291 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:21:34.544 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:21:34.548 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:22:04.617 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:22:04.621 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:22:35.006 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:22:35.009 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:22:35.072 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:22:35.071+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34342) UID: 0 2022-03-21T16:22:35.073 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:22:35.071+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34342) UID: 0 2022-03-21T16:22:35.074 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:22:35.071+0000 7f69077c3700 -1 Fail to open '/proc/34342/cmdline' error = (2) No such file or directory 2022-03-21T16:22:35.074 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:22:35.071+0000 7f69077c3700 -1 received signal: Hangup from (PID: 34342) UID: 0 2022-03-21T16:23:57.706 INFO:tasks.ceph.mds.f.smithi171.stderr:tcmalloc: large alloc 3355443200 bytes == 0x55d16dcd0000 @ 0x7f690f38d760 0x7f690f3aec64 0x55d0a2dc57bd 0x55d0a2dc0bb6 0x55d0a2c56179 0x55d0a2c49ca8 0x55d0a2aafb9a 0x55d0a2afa7cb 0x55d0a2ba372c 0x55d0a2d73443 0x55d0a2d95347 0x55d0a2c3f326 0x55d0a2c4472a 0x55d0a2c4df0a 0x55d0a2c51f34 0x55d0a2a509c4 0x55d0a2a535fb 0x55d0a2a53c1c 0x55d0a2a42b18 0x7f690ea66dea 0x7f690eb1e411 0x7f690d7b814a 0x7f690c2d1dc3 2022-03-21T16:24:39.026 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:24:39.029 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:25:09.177 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:25:09.180 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:25:39.231 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:25:39.236 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:26:09.730 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:26:09.734 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:26:39.852 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:26:39.855 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:26:39.976 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:26:39.973+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34462) UID: 0 2022-03-21T16:26:39.976 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:26:39.973+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34462) UID: 0 2022-03-21T16:26:39.977 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:26:39.973+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34462) UID: 0 2022-03-21T16:28:43.891 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:28:43.894 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:28:43.928 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T16:28:43.928+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37718) UID: 0 2022-03-21T16:28:43.929 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T16:28:43.928+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37718) UID: 0 2022-03-21T16:28:43.929 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T16:28:43.928+0000 7f6398c04700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37718) UID: 0 2022-03-21T16:31:31.170 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:31:31.185 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:31:31.234 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:31:31.231+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34543) UID: 0 2022-03-21T16:31:31.235 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:31:31.231+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34543) UID: 0 2022-03-21T16:31:31.235 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:31:31.231+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34543) UID: 0 2022-03-21T16:36:01.088 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:36:01.116 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:36:01.253 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:36:01.250+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34604) UID: 0 2022-03-21T16:36:01.254 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:36:01.250+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34604) UID: 0 2022-03-21T16:36:01.254 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:36:01.250+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34604) UID: 0 2022-03-21T16:40:50.357 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:40:50.361 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:40:50.438 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:40:50.436+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34669) UID: 0 2022-03-21T16:40:50.438 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:40:50.436+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34669) UID: 0 2022-03-21T16:40:50.439 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:40:50.437+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34669) UID: 0 2022-03-21T16:43:07.254 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:43:07.258 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:43:37.349 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:43:37.355 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:44:07.820 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:44:07.824 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:44:37.886 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:44:37.889 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:45:08.102 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:45:08.105 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:45:08.142 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:45:08.140+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34790) UID: 0 2022-03-21T16:45:08.148 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:45:08.140+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34790) UID: 0 2022-03-21T16:45:08.149 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:45:08.140+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34790) UID: 0 2022-03-21T16:47:16.908 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:47:16.912 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:47:46.987 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:47:46.990 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:48:17.392 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:48:17.395 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:48:47.515 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:48:47.518 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:49:17.654 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:49:17.659 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:49:17.695 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:49:17.692+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34910) UID: 0 2022-03-21T16:49:17.695 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:49:17.692+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34910) UID: 0 2022-03-21T16:49:17.696 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:49:17.692+0000 7fd5c60a5700 -1 Fail to open '/proc/34910/cmdline' error = (2) No such file or directory 2022-03-21T16:49:17.696 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:49:17.692+0000 7fd5c60a5700 -1 received signal: Hangup from (PID: 34910) UID: 0 2022-03-21T16:51:22.525 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:51:22.529 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:51:52.642 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:51:52.645 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:52:22.750 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:52:22.753 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:52:52.898 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:52:52.901 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:53:23.250 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:53:23.253 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:53:23.290 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:53:23.288+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35035) UID: 0 2022-03-21T16:53:23.291 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:53:23.288+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35035) UID: 0 2022-03-21T16:53:23.291 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:53:23.289+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35035) UID: 0 2022-03-21T16:55:27.284 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:55:27.287 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:55:57.550 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:55:57.554 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:56:28.124 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:56:28.127 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:56:58.187 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:56:58.190 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:57:28.310 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:57:28.313 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:57:28.361 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T16:57:28.359+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35155) UID: 0 2022-03-21T16:57:28.362 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T16:57:28.359+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35155) UID: 0 2022-03-21T16:57:28.362 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T16:57:28.359+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35155) UID: 0 2022-03-21T16:59:31.103 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:59:31.107 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T16:59:31.138 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T16:59:31.135+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38386) UID: 0 2022-03-21T16:59:31.138 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T16:59:31.135+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38386) UID: 0 2022-03-21T16:59:31.139 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T16:59:31.135+0000 7f6398c04700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38386) UID: 0 2022-03-21T17:02:18.676 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:02:18.679 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:02:18.874 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:02:18.871+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35247) UID: 0 2022-03-21T17:02:18.875 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:02:18.871+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35247) UID: 0 2022-03-21T17:02:18.875 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:02:18.871+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35247) UID: 0 2022-03-21T17:09:57.656 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:09:57.688 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:09:57.751 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:09:57.749+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35334) UID: 0 2022-03-21T17:09:57.752 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:09:57.749+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35334) UID: 0 2022-03-21T17:09:57.752 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:09:57.749+0000 7f69077c3700 -1 Fail to open '/proc/35334/cmdline' error = (2) No such file or directory 2022-03-21T17:09:57.752 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:09:57.749+0000 7f69077c3700 -1 received signal: Hangup from (PID: 35334) UID: 0 2022-03-21T17:14:54.191 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:14:54.197 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:14:54.237 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:14:54.234+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35398) UID: 0 2022-03-21T17:14:54.238 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:14:54.234+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35398) UID: 0 2022-03-21T17:14:54.238 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:14:54.234+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35398) UID: 0 2022-03-21T17:17:21.869 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:17:21.872 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:17:52.011 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:17:52.014 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:18:22.583 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:18:22.586 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:18:53.056 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:18:53.059 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:19:23.130 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:19:23.133 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:19:23.171 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:19:23.167+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35518) UID: 0 2022-03-21T17:19:23.172 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:19:23.167+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35518) UID: 0 2022-03-21T17:19:23.173 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:19:23.168+0000 7f69077c3700 -1 Fail to open '/proc/35518/cmdline' error = (2) No such file or directory 2022-03-21T17:19:23.173 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:19:23.168+0000 7f69077c3700 -1 received signal: Hangup from (PID: 35518) UID: 0 2022-03-21T17:21:34.965 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:21:34.970 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:22:05.019 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:22:05.023 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:22:35.525 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:22:35.531 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:23:05.681 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:23:05.684 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:23:36.282 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:23:36.285 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:23:36.323 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:23:36.320+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35642) UID: 0 2022-03-21T17:23:36.323 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:23:36.320+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35642) UID: 0 2022-03-21T17:23:36.324 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:23:36.320+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35642) UID: 0 2022-03-21T17:25:42.969 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:25:42.973 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:26:13.283 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:26:13.285 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:26:43.338 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:26:43.341 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:27:13.469 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:27:13.472 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:27:43.556 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:27:43.560 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:27:43.627 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:27:43.625+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35770) UID: 0 2022-03-21T17:27:43.628 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:27:43.625+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35770) UID: 0 2022-03-21T17:27:43.628 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:27:43.625+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35770) UID: 0 2022-03-21T17:29:47.000 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:29:47.006 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:29:47.086 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:29:47.083+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35806) UID: 0 2022-03-21T17:29:47.087 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:29:47.083+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35806) UID: 0 2022-03-21T17:29:47.087 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:29:47.083+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35806) UID: 0 2022-03-21T17:32:05.918 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:32:05.922 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:32:05.956 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T17:32:05.954+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39227) UID: 0 2022-03-21T17:32:05.956 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T17:32:05.954+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39227) UID: 0 2022-03-21T17:32:05.957 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T17:32:05.954+0000 7f6398c04700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39227) UID: 0 2022-03-21T17:32:05.963 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:32:05.958+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35846) UID: 0 2022-03-21T17:32:05.963 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:32:05.958+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35846) UID: 0 2022-03-21T17:32:05.964 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:32:05.958+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35846) UID: 0 2022-03-21T17:35:00.011 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:35:00.016 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:35:00.071 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:35:00.064+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35890) UID: 0 2022-03-21T17:35:00.072 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:35:00.064+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35890) UID: 0 2022-03-21T17:35:00.073 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:35:00.064+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35890) UID: 0 2022-03-21T17:37:17.622 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:37:17.627 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:37:17.663 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:37:17.662+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35926) UID: 0 2022-03-21T17:37:17.664 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:37:17.662+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35926) UID: 0 2022-03-21T17:37:17.665 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:37:17.662+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35926) UID: 0 2022-03-21T17:39:44.640 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:39:44.644 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:40:14.696 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:40:14.700 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:40:44.787 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:40:44.790 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:41:14.908 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:41:14.911 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:41:45.273 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:41:45.276 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:41:45.313 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:41:45.311+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36059) UID: 0 2022-03-21T17:41:45.313 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:41:45.311+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36059) UID: 0 2022-03-21T17:41:45.314 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:41:45.311+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36059) UID: 0 2022-03-21T17:43:57.300 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:43:57.304 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:44:27.427 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:44:27.430 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:44:57.483 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:44:57.486 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:45:27.623 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:45:27.628 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:45:57.721 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:45:57.724 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:45:57.761 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:45:57.759+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36179) UID: 0 2022-03-21T17:45:57.762 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:45:57.759+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36179) UID: 0 2022-03-21T17:45:57.763 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:45:57.759+0000 7f69077c3700 -1 Fail to open '/proc/36179/cmdline' error = (2) No such file or directory 2022-03-21T17:45:57.763 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:45:57.759+0000 7f69077c3700 -1 received signal: Hangup from (PID: 36179) UID: 0 2022-03-21T17:48:03.772 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:48:03.775 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:48:34.329 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:48:34.332 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:49:04.613 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:49:04.616 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:49:34.696 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:49:34.699 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:50:04.818 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:50:04.821 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:50:04.858 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:50:04.855+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36300) UID: 0 2022-03-21T17:50:04.859 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:50:04.855+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36300) UID: 0 2022-03-21T17:50:04.859 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:50:04.855+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36300) UID: 0 2022-03-21T17:52:08.712 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:52:08.715 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:52:38.774 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:52:38.777 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:53:09.260 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:53:09.263 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:53:39.335 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:53:39.338 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:54:09.683 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:54:09.689 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:54:09.730 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:54:09.729+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36423) UID: 0 2022-03-21T17:54:09.731 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:54:09.729+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36423) UID: 0 2022-03-21T17:54:09.731 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:54:09.729+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36423) UID: 0 2022-03-21T17:56:14.409 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:56:14.412 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:56:14.449 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:56:14.447+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36459) UID: 0 2022-03-21T17:56:14.450 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:56:14.447+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36459) UID: 0 2022-03-21T17:56:14.450 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:56:14.447+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36459) UID: 0 2022-03-21T17:58:22.928 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:58:22.931 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T17:58:23.151 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T17:58:23.147+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36694) UID: 0 2022-03-21T17:58:23.152 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T17:58:23.147+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36694) UID: 0 2022-03-21T17:58:23.153 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T17:58:23.148+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36694) UID: 0 2022-03-21T18:00:27.677 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:00:27.681 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:00:57.941 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:00:57.946 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:01:28.113 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:01:28.126 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:01:58.193 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:01:58.197 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:02:28.541 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:02:28.544 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:02:28.577 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T18:02:28.575+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39992) UID: 0 2022-03-21T18:02:28.578 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T18:02:28.575+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39992) UID: 0 2022-03-21T18:02:28.579 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T18:02:28.575+0000 7f6398c04700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39992) UID: 0 2022-03-21T18:02:28.585 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:02:28.583+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36827) UID: 0 2022-03-21T18:02:28.586 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:02:28.583+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36827) UID: 0 2022-03-21T18:02:28.586 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:02:28.583+0000 7f69077c3700 -1 Fail to open '/proc/36827/cmdline' error = (2) No such file or directory 2022-03-21T18:02:28.587 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:02:28.583+0000 7f69077c3700 -1 received signal: Hangup from (PID: 36827) UID: 0 2022-03-21T18:05:14.131 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:05:14.134 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:05:44.503 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:05:44.506 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:05:44.544 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:05:44.543+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36896) UID: 0 2022-03-21T18:05:44.545 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:05:44.543+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36896) UID: 0 2022-03-21T18:05:44.545 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:05:44.543+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36896) UID: 0 2022-03-21T18:08:18.618 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:08:18.622 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:08:18.681 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:08:18.679+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36932) UID: 0 2022-03-21T18:08:18.681 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:08:18.679+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36932) UID: 0 2022-03-21T18:08:18.682 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:08:18.679+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 36932) UID: 0 2022-03-21T18:11:00.439 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:11:00.443 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:11:30.800 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:11:30.803 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:12:00.868 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:12:00.871 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:12:30.922 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:12:30.925 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:12:30.964 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:12:30.962+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37039) UID: 0 2022-03-21T18:12:30.966 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:12:30.962+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37039) UID: 0 2022-03-21T18:12:30.966 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:12:30.962+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37039) UID: 0 2022-03-21T18:14:36.422 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:14:36.427 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:15:06.974 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:15:06.977 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:15:37.049 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:15:37.052 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:16:07.203 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:16:07.207 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:16:37.526 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:16:37.529 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:16:37.567 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:16:37.564+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37159) UID: 0 2022-03-21T18:16:37.568 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:16:37.564+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37159) UID: 0 2022-03-21T18:16:37.569 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:16:37.564+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37159) UID: 0 2022-03-21T18:18:41.978 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:18:41.981 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:19:12.241 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:19:12.244 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:19:42.547 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:19:42.550 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:20:12.611 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:20:12.614 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:20:42.708 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:20:42.711 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:20:42.749 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:20:42.748+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37284) UID: 0 2022-03-21T18:20:42.750 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:20:42.748+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37284) UID: 0 2022-03-21T18:20:42.750 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:20:42.748+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37284) UID: 0 2022-03-21T18:22:45.976 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:22:45.979 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:22:46.054 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:22:46.052+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37328) UID: 0 2022-03-21T18:22:46.055 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:22:46.052+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37328) UID: 0 2022-03-21T18:22:46.055 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:22:46.052+0000 7f69077c3700 -1 Fail to open '/proc/37328/cmdline' error = (2) No such file or directory 2022-03-21T18:22:46.055 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:22:46.052+0000 7f69077c3700 -1 received signal: Hangup from (PID: 37328) UID: 0 2022-03-21T18:25:00.175 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:25:00.179 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:25:00.228 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:25:00.226+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37364) UID: 0 2022-03-21T18:25:00.228 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:25:00.226+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37364) UID: 0 2022-03-21T18:25:00.229 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:25:00.226+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37364) UID: 0 2022-03-21T18:27:05.834 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:27:05.837 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:27:35.990 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:27:35.993 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:28:06.061 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:28:06.064 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:28:36.228 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:28:36.232 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:29:06.288 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:29:06.291 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:29:06.328 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:29:06.326+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37484) UID: 0 2022-03-21T18:29:06.329 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:29:06.326+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37484) UID: 0 2022-03-21T18:29:06.330 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:29:06.326+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37484) UID: 0 2022-03-21T18:31:10.023 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:31:10.027 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:31:40.095 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:31:40.098 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:32:10.414 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:32:10.417 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:32:40.585 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:32:40.588 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:33:10.707 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:33:10.710 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:33:10.751 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T18:33:10.749+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40757) UID: 0 2022-03-21T18:33:10.751 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T18:33:10.749+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40757) UID: 0 2022-03-21T18:33:10.752 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T18:33:10.749+0000 7f6398c04700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40757) UID: 0 2022-03-21T18:33:10.757 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:33:10.756+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37609) UID: 0 2022-03-21T18:33:10.757 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:33:10.756+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37609) UID: 0 2022-03-21T18:33:10.758 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:33:10.756+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37609) UID: 0 2022-03-21T18:35:57.482 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:35:57.487 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:36:27.768 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:36:27.773 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:36:27.811 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:36:27.809+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37670) UID: 0 2022-03-21T18:36:27.812 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:36:27.809+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37670) UID: 0 2022-03-21T18:36:27.812 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:36:27.809+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37670) UID: 0 2022-03-21T18:38:57.487 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:38:57.491 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:38:57.558 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:38:57.557+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37715) UID: 0 2022-03-21T18:38:57.559 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:38:57.557+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37715) UID: 0 2022-03-21T18:38:57.560 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:38:57.557+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37715) UID: 0 2022-03-21T18:41:44.684 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:41:44.688 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:42:14.746 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:42:14.749 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:42:44.876 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:42:44.879 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:43:15.207 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:43:15.210 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:43:15.247 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:43:15.245+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37822) UID: 0 2022-03-21T18:43:15.248 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:43:15.245+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37822) UID: 0 2022-03-21T18:43:15.248 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:43:15.245+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37822) UID: 0 2022-03-21T18:45:23.458 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:45:23.462 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:45:53.603 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:45:53.606 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:46:23.744 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:46:23.747 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:46:53.809 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:46:53.812 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:47:24.165 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:47:24.168 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:47:24.205 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:47:24.203+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37942) UID: 0 2022-03-21T18:47:24.206 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:47:24.203+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37942) UID: 0 2022-03-21T18:47:24.207 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:47:24.203+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37942) UID: 0 2022-03-21T18:49:28.689 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:49:28.693 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:49:28.730 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:49:28.728+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37978) UID: 0 2022-03-21T18:49:28.731 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:49:28.728+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37978) UID: 0 2022-03-21T18:49:28.731 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:49:28.728+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37978) UID: 0 2022-03-21T18:51:38.431 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:51:38.434 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:51:38.676 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:51:38.675+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38019) UID: 0 2022-03-21T18:51:38.677 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:51:38.676+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38019) UID: 0 2022-03-21T18:51:38.678 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:51:38.676+0000 7f69077c3700 -1 Fail to open '/proc/38019/cmdline' error = (2) No such file or directory 2022-03-21T18:51:38.678 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:51:38.676+0000 7f69077c3700 -1 received signal: Hangup from (PID: 38019) UID: 0 2022-03-21T18:53:18.681 INFO:tasks.ceph.mds.f.smithi171.stderr:tcmalloc: large alloc 6710886400 bytes == 0x55d2364d0000 @ 0x7f690f38d760 0x7f690f3aec64 0x55d0a2dc57bd 0x55d0a2dc0bb6 0x55d0a2c56179 0x55d0a2c49ca8 0x55d0a2aafb9a 0x55d0a2afa7cb 0x55d0a2ba372c 0x55d0a2d73443 0x55d0a2d95347 0x55d0a2c3f326 0x55d0a2c4472a 0x55d0a2c4df0a 0x55d0a2c51f34 0x55d0a2a509c4 0x55d0a2a535fb 0x55d0a2a53c1c 0x55d0a2a42b18 0x7f690ea66dea 0x7f690eb1e411 0x7f690d7b814a 0x7f690c2d1dc3 2022-03-21T18:53:43.363 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:53:43.366 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:54:13.487 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:54:13.490 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:54:43.542 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:54:43.545 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:55:13.835 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:55:13.838 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:55:44.132 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:55:44.136 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:55:44.168 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:55:44.166+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38139) UID: 0 2022-03-21T18:55:44.168 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:55:44.166+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38139) UID: 0 2022-03-21T18:55:44.169 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:55:44.166+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38139) UID: 0 2022-03-21T18:57:47.383 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:57:47.387 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:58:17.520 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:58:17.523 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:58:47.929 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:58:47.933 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:59:17.991 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:59:17.994 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:59:48.406 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:59:48.409 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T18:59:48.447 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T18:59:48.445+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38267) UID: 0 2022-03-21T18:59:48.447 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T18:59:48.445+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38267) UID: 0 2022-03-21T18:59:48.448 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:59:48.445+0000 7fd5c60a5700 -1 Fail to open '/proc/38267/cmdline' error = (2) No such file or directory 2022-03-21T18:59:48.448 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T18:59:48.445+0000 7fd5c60a5700 -1 received signal: Hangup from (PID: 38267) UID: 0 2022-03-21T19:01:51.051 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:01:51.054 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:02:21.211 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:02:21.214 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:02:51.269 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:02:51.272 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:03:21.363 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:03:21.366 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:03:51.476 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:03:51.478 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:03:51.512 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T19:03:51.510+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41668) UID: 0 2022-03-21T19:03:51.513 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T19:03:51.510+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41668) UID: 0 2022-03-21T19:03:51.513 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T19:03:51.510+0000 7f6398c04700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41668) UID: 0 2022-03-21T19:03:51.517 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:03:51.516+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38402) UID: 0 2022-03-21T19:03:51.517 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:03:51.516+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38402) UID: 0 2022-03-21T19:03:51.518 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:03:51.516+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38402) UID: 0 2022-03-21T19:06:38.693 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:06:38.697 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:07:09.032 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:07:09.035 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:07:09.073 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:07:09.071+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38463) UID: 0 2022-03-21T19:07:09.073 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:07:09.071+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38463) UID: 0 2022-03-21T19:07:09.074 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:07:09.071+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38463) UID: 0 2022-03-21T19:09:36.700 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:09:36.704 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:09:36.755 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:09:36.752+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38500) UID: 0 2022-03-21T19:09:36.756 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:09:36.752+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38500) UID: 0 2022-03-21T19:09:36.756 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:09:36.752+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38500) UID: 0 2022-03-21T19:12:17.108 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:12:17.112 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:12:47.460 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:12:47.464 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:13:17.587 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:13:17.590 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:13:47.934 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:13:47.937 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:13:47.976 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:13:47.973+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38614) UID: 0 2022-03-21T19:13:47.977 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:13:47.973+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38614) UID: 0 2022-03-21T19:13:47.977 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:13:47.973+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38614) UID: 0 2022-03-21T19:15:53.170 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:15:53.173 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:15:53.223 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:15:53.222+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38650) UID: 0 2022-03-21T19:15:53.224 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:15:53.222+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38650) UID: 0 2022-03-21T19:15:53.224 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:15:53.222+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38650) UID: 0 2022-03-21T19:18:02.140 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:18:02.144 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:18:02.183 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:18:02.180+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38686) UID: 0 2022-03-21T19:18:02.183 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:18:02.180+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38686) UID: 0 2022-03-21T19:18:02.184 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:18:02.180+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38686) UID: 0 2022-03-21T19:20:08.142 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:20:08.146 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:20:38.800 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:20:38.803 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:21:09.132 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:21:09.136 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:21:39.283 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:21:39.286 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:22:09.338 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:22:09.341 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:22:09.379 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:22:09.378+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38811) UID: 0 2022-03-21T19:22:09.380 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:22:09.378+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38811) UID: 0 2022-03-21T19:22:09.380 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:22:09.378+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38811) UID: 0 2022-03-21T19:24:13.891 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:24:13.895 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:24:44.011 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:24:44.013 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:25:14.068 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:25:14.071 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:25:44.199 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:25:44.202 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:26:14.318 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:26:14.321 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:26:14.463 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:26:14.461+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38931) UID: 0 2022-03-21T19:26:14.464 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:26:14.461+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38931) UID: 0 2022-03-21T19:26:14.464 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:26:14.461+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 38931) UID: 0 2022-03-21T19:28:17.416 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:28:17.420 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:28:47.584 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:28:47.588 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:29:18.025 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:29:18.028 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:29:48.499 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:29:48.502 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:30:18.826 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:30:18.829 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:30:18.866 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:30:18.864+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39056) UID: 0 2022-03-21T19:30:18.867 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:30:18.864+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39056) UID: 0 2022-03-21T19:30:18.867 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:30:18.864+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39056) UID: 0 2022-03-21T19:32:22.681 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:32:22.685 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:32:52.985 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:32:52.988 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:33:23.065 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:33:23.069 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:33:53.394 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:33:53.397 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:34:23.488 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:34:23.491 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:34:23.526 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T19:34:23.524+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42620) UID: 0 2022-03-21T19:34:23.527 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T19:34:23.524+0000 7f6398c04700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42620) UID: 0 2022-03-21T19:34:23.527 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T19:34:23.524+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42620) UID: 0 2022-03-21T19:34:23.528 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:34:23.526+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39176) UID: 0 2022-03-21T19:34:23.550 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:34:23.526+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39176) UID: 0 2022-03-21T19:34:23.550 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:34:23.526+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39176) UID: 0 2022-03-21T19:37:09.896 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:37:09.900 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:37:40.433 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:37:40.437 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:37:40.486 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:37:40.483+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39237) UID: 0 2022-03-21T19:37:40.486 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:37:40.483+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39237) UID: 0 2022-03-21T19:37:40.487 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:37:40.484+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39237) UID: 0 2022-03-21T19:40:11.761 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:40:11.765 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:40:11.803 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:40:11.802+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39286) UID: 0 2022-03-21T19:40:11.804 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:40:11.802+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39286) UID: 0 2022-03-21T19:40:11.804 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:40:11.802+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39286) UID: 0 2022-03-21T19:43:00.075 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:43:00.079 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:43:00.258 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:43:00.255+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39330) UID: 0 2022-03-21T19:43:00.260 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:43:00.255+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39330) UID: 0 2022-03-21T19:43:00.261 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:43:00.255+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39330) UID: 0 2022-03-21T19:45:53.846 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:45:53.850 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:45:53.900 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:45:53.898+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39374) UID: 0 2022-03-21T19:45:53.900 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:45:53.898+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39374) UID: 0 2022-03-21T19:45:53.901 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:45:53.898+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39374) UID: 0 2022-03-21T19:48:35.253 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:48:35.258 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:49:05.704 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:49:05.709 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:49:35.992 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:49:35.996 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:50:06.067 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:50:06.071 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:50:06.127 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:50:06.126+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39489) UID: 0 2022-03-21T19:50:06.127 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:50:06.126+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39489) UID: 0 2022-03-21T19:50:06.128 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:50:06.126+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39489) UID: 0 2022-03-21T19:52:12.142 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:52:12.146 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:52:42.471 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:52:42.474 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:53:12.544 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:53:12.547 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:53:43.034 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:53:43.036 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:54:13.105 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:54:13.108 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:54:13.186 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:54:13.146+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39613) UID: 0 2022-03-21T19:54:13.187 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:54:13.146+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39613) UID: 0 2022-03-21T19:54:13.207 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:54:13.146+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39613) UID: 0 2022-03-21T19:55:45.288 INFO:teuthology.orchestra.run.smithi171.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.f.log.1: 2022-03-21T19:55:45.289 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: stdin: file size changed while zipping 2022-03-21T19:56:18.520 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:56:18.523 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:56:48.667 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:56:48.670 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:57:18.806 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:57:18.809 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:57:48.873 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:57:48.876 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:58:19.021 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:58:19.025 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T19:58:19.069 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T19:58:19.067+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39921) UID: 0 2022-03-21T19:58:19.070 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T19:58:19.067+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39921) UID: 0 2022-03-21T19:58:19.070 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T19:58:19.068+0000 7f465ad36700 -1 received signal: Hangup from (PID: 39921) UID: 0 2022-03-21T20:00:22.689 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:00:22.693 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:00:52.824 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:00:52.827 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:01:23.304 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:01:23.308 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:01:53.714 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:01:53.717 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:02:23.986 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:02:23.989 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:02:24.031 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T20:02:24.030+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40054) UID: 0 2022-03-21T20:02:24.031 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T20:02:24.030+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40054) UID: 0 2022-03-21T20:02:24.032 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T20:02:24.030+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40054) UID: 0 2022-03-21T20:04:26.879 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:04:26.883 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:04:57.252 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:04:57.255 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:04:57.290 INFO:tasks.ceph.mds.a.smithi160.stderr:2022-03-21T20:04:57.288+0000 7fa474d39700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43352) UID: 0 2022-03-21T20:04:57.291 INFO:tasks.ceph.mds.c.smithi160.stderr:2022-03-21T20:04:57.288+0000 7f95bd1b7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43352) UID: 0 2022-03-21T20:04:57.291 INFO:tasks.ceph.mds.e.smithi160.stderr:2022-03-21T20:04:57.288+0000 7f6398c04700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43352) UID: 0 2022-03-21T20:07:43.787 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:07:43.791 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:07:43.841 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T20:07:43.840+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40149) UID: 0 2022-03-21T20:07:43.841 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T20:07:43.840+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40149) UID: 0 2022-03-21T20:07:43.842 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T20:07:43.840+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40149) UID: 0 2022-03-21T20:10:18.396 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:10:18.399 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:10:18.464 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T20:10:18.463+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40292) UID: 0 2022-03-21T20:10:18.464 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T20:10:18.463+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40292) UID: 0 2022-03-21T20:10:18.465 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T20:10:18.463+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40292) UID: 0 2022-03-21T20:15:38.637 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:15:38.641 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-21T20:15:38.707 INFO:tasks.ceph.mds.b.smithi171.stderr:2022-03-21T20:15:38.706+0000 7f465ad36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40354) UID: 0 2022-03-21T20:15:38.708 INFO:tasks.ceph.mds.d.smithi171.stderr:2022-03-21T20:15:38.706+0000 7fd5c60a5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40354) UID: 0 2022-03-21T20:15:38.708 INFO:tasks.ceph.mds.f.smithi171.stderr:2022-03-21T20:15:38.706+0000 7f69077c3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40354) UID: 0 2022-03-21T20:16:46.464 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-03-21T20:16:46.465 DEBUG:teuthology.task.console_log:Killing console logger for smithi160 2022-03-21T20:16:46.467 DEBUG:teuthology.task.console_log:Killing console logger for smithi171 2022-03-21T20:16:46.467 DEBUG:teuthology.exit:Finished running handlers